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1. Introductory Remarks. The statistical technique known as 
“analysis of variance,’’ developed more than two decades ago by R. A. 
Fisher to facilitate the analysis and interpretation of data from field 
trials and laboratory experiments in agricultural and biological re- 
search, today constitutes one of the principal research tools of the bio- 
logical scientist, and its use is spreading rapidly in the social sciences, 
the physical sciences, and in engineering. Numerous textbooks (or, 
should I say ‘‘manuals’’?) have been published—and, I dare say, many 
more are being written—that aim to provide their readers with a work- 
ing knowledge of the steps of analysis-of-variance procedure with a 
minimum exposure to mathematical formulas and mathematical think- 
ing. Designed expressly for the ‘‘non-mathematical reader’’, whose 
mathematical equipment is presumed to be a reasonable competence in 
arithmetic and elementary algebra—mere previous exposure to these 
subjects is not enough. The method of instruction adopted in these 
books consists chiefly in guiding the reader by easy stages through a 
series of worked examples that are typical of the more common prob- 
lems amenable to analysis of variance that arise in the scientific or 
engineering field with which the author of the book concerned is con- 
versant.t 


* An expository address delivered at a joint session of the Biometrics Section of the 
American Statistical Association and the Institute of Mathematical Statistics, held on 
December 28, 1946, in conjunction with the 113th Annual Meeting of the American Asso- 
ciation for the Advancement of Science, Boston, Massachusetts. 

1The author has found the discussions and examples of analysis-of-variance pro- 
cedures given in the following four books especially valuable both for reference and for 
purposes of instruction : C. H. Goulden, Methods of Statistical Analysis ; G. W. Snedecor, 
Calculation and Interpretation of Analysis of Variance and Covariance ; G. W. Snedecor, 
Statistical Methods ; L. H. C. Tippett, The Methods of Statistics. See full bibliographical 
references at the end of this paper. 


These introductions to analysis of variance have been definitely 
worthwhile in at least three respects: first, they have acquainted a 
larger audience with the procedures of analysis of variance and its 
value as a research tool than probably would have been achieved by 
more mathematical expositions of the subject (even unfavorable reviews 
of some of these books have focused attention on the analysis of vari- 
ance itself as a research tool ‘‘that needs further looking into’’) ; 
second, by studying the worked examples provided and by carrying 
through analogous steps with data of their own, readers of these books 
have developed an amazing proficiency with the arithmetical steps in- 
volved, even in the cases of analyses associated with fairly complicated 
experimental designs which probably would not have been attempted 
or, if attempted, almost certainly would not have been analyzed cor- 
rectly without the aid of these books; and third, since the worked exam- 
ples given in these books have generally illustrated statistically sound 
experimental designs which were more efficient than the designs previ- 
ously used by their readers, these readers have frequently adopted 
analogous designs in their own research (in order to be able to follow 
the book when the data are in and are crying for analysis), with a 
resulting general improvement of research procedure. 

The principal deficiency of these books has been their failure to 
state explicitly the several asumptions underlying the analysis of vari- 
ance, and to indicate the importance of each from a practical viewpoint. 
The mathematical treatments of analysis of variance have shared this 
deficiency to some extent, for, while they have posited the necessary 
and sufficient conditions? for strict validity of the entire set of analysis- 
of-variance procedures and associated tests of significance, they have 
not generally indicated in sufficient detail the actual functions of the 
respective assumptions—1) which can be dispensed with for certain 
purposes; 2) which are absolutely necessary, and what are likely to be 
the consequences if these are not fulfilled; and 3) what can be done 
“‘to bring into line,’’ for purposes of analysis, data which in their 
original form are not amenable to analysis of variance.* In this paper 
I shall go into these matters in some detail. My assignment is to 


2The conditions here referred to-are certainly sufficient: they may be necessary in 
the mathematical sense, but no proof of this is known to the writer. For a variety of 
reasons he believes them to be “necessary in practice” in the same sense that, if there 
are exceptions, the circumstances required would be regarded by the practical man as 
“pathological.” 

3 See, for example, the discussions of analysis of variance in H. Cramér, Mathemat- 
ical Methods of Statistics; in M. G. Kendall, The Advanced Theory of Statistics, Vol- 
ume II; and in S. 8S. Wilks, Mathematical Statistics. Somewhat more complete dis- 
cussions have been given by J. O. Irwin in his paper entitled ‘Mathematical Theorems 
Involved in the Analysis of Variance’ and in his note “On the Independence of the 
Constituent Items in the Analysis of Variance.” 
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enumerate the several assumptions underlying the analysis of variance 
and to point out the practical importance of each. As we shall see, 
these assumptions are quite simple to state, and the practical signifi- 
eance of each not difficult to grasp. Professor Cochran, in the second 
paper of this issue of Biometrics, tells of some of the consequences 
to expect when certain of these assumptions are not fulfilled. Finally, 
Professor Bartlett, in the third paper, indicates how, by the use of 
transformations, some of these consequences can be avoided and valid 
conclusions reached by analysis of variance, when the data in their 
original form are essentially intractable by analysis of variance. 


2. Iwo Distinct Classes of Problems Solvable by Analysis of Vari- 
ance. Turning now to my assignment, I am obliged at the outset to 
draw attention to the fact that analysis of variance can be, and is, used 
to provide solutions to problems of two fundamentally different types. 
These two distinct classes of problems are: 

(2.1) Class I: Detection and Estimation of Fixed (Constant) Rela- 
tions Among the Means of Sub-Sets of the Universe of Objects Con- 
cerned. This class includes all of the usual problems of estimating, 
and testing to determine whether to infer the existence of, true differ- 
ences among ‘‘treatment’’ means, among ‘‘variety”’ means, and, under 
certain conditions, among ‘‘place’’? means. Included in this class are 
all the problems of univariate and multivariate regression and of har- 
monic analysis. With respect to the problems of estimation belonging 
to this class, analysis of variance is simply a form of the method of 
least squares: the analysis-of-variance solutions are the least-squares 
solutions, The cardinal contribution of analysis of variance to the 
actual procedure is the analysis-of-variance table devised by R. A. 
Fisher, which serves to simplify the arithmetical steps and to bring out 
more clearly the significance of the results obtained. The analysis-of- 
variance tests of significance employed in connection with problems 
of this class are simply extensions to small samples of the theory of 
Oo ee Sw ee 


Entered as second-class matter, May 25, 1945, at the post office at Washington, 
D. C., under the Act of March 3, 1879. Biometrics is published four times a year—in 
March, June, September and December—by the American Statistical Association for its 
Biometrics Section. Editorial Office: 1603 K Street, N. W., Washington 6, D. C. 

Membership dues in the American Statistical Association are $5.00 a year, of which 
$3.00 is for a year’s subscription to the quarterly Journal, fifty cents is for a year’s 
subscription to the ASA Bulletin. Dues for Associate members of the Biometrics Sec- 
tion are $2.00 a year, of which $1.00 is for a year’s subscription to Biometrics. Single 
copies of Biometrics are $1.00 each and annual subscriptions are $2.00. Subscriptions 
and applications for membership should be sent to the American Statistical Association, 
1603 K Street, N. W., Washington 6, D. C. 


least squares developed by Gauss and others—the extension of the the- 
ory to small samples being due principally to R. A. Fisher. 

(2.2) Class II: Detection and Estimation of Components of (Ran- 
dom) Variation Associated with a Composite Population. This class 
ineludes all problems of estimating, and testing to determine whether 
to infer the existence of, components of variance ascribable to random 
deviation of the characteristics of individuals of a particular generic 
type from the mean values of these characteristics in the ‘‘population’’ 
of all individuals of that generic type, ete. In a sense, this is the true 
analysis of variance, and the estimation of the respective components 
of the over-all variance of a single observation requires further steps 
beyond the evaluations of the entries of the analysis-of-variance table 
itself. Problems of this class have received considerably less attention 
in the literature of analysis of variance than have problems of Class I.* 

The failure of most of the literature on analysis of variance to focus 
attention on the distinction between problems of Class I and problems 
of Class IT is very likely due to two facts: first, the literature of analy- 
sis of variance deals largely with tests of significance in contrast to 
problems of estimation; second, when analysis of variance is used 
merely to determine whether to infer (a) the existence of fixed differ- 
ences among the true means of the sub-sets concerned or (b) the exist- 
ence of a component of variance ascribable to a particular factor, the 
computational procedure and the mechanics of the statistical tests of 
significance are the same in either case—the same test criterion (F or z) 
is evaluated and referred to the same “‘levels of significance’’ in either 
ease. On the other hand, in the estimation of the relevant parameters, 
and in the evaluation of the efficiency or resolving power of a particular 
experimental design, the distinction between these two classes of prob- 
lems needs to be taken into account, since in problems of Class I the 
parameters involved are means and the issues of interest are concerned 
with the interrelations of these means, i.e., with the differences between 
pairs of them, with their functional dependence on some independent 
variable(s), ete.; whereas in problems of Class II the parameters in- 
volved are variances and their absolute and relative magnitudes are of 
primary importance. In other words, the mathematical models appro- 
priate to problems of Class I differ from the mathematical models 


4h. A. Fisher gives a brief discussion of estimating, and testing for the existence 
of components of variance in Section 40 of his Statistical Methods for Research Workers. 
Tippett considers such problems in Sections 6.1-6.2, 6.4, 10.11, and 10.3. Snedecor’s 
treatment is somewhat more complete: Statistical Methods, Sections 10.6-10.12, 11.4, 
11.7—-11.8, 11.14, 11.16. The most complete discussions of problems of Class II are 
H. BH. Daniels, ‘‘The Estimation of Components of Variance,” and S. Lee Crump, ‘‘The 
Estimation of Variance Components in Analysis of Variance.” 
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appropriate to problems of Class II, and consequently, so do the ques- 
tions to be answered by the data. 


3. The Algebra of Analysis of Variance. It was remarked above 
that the computational steps leading to an analysis-of-variance table 
are the same for problems of Class I and Class II. This is due largely 
to the fact that the decomposition of the (total) sum of squared devi- 
ations of the individual observations from the general mean of the 
observations into two or more ‘‘sums of squares’’ is based in every case 
upon an algebraic identity (appropriate to the case concerned) that is 
valid whatever the meanings of the numbers involved. To demonstrate 
this in complete generality would render the substance of this paper 
somewhat complicated, and these complexities would, I fear, distract 
attention from the main theme. Accordingly, I shall restrict myself 
to consideration of the algebra of the decomposition for the case of re 
numbers arranged in a rectangular array of r rows and c columns. 
In order to be able to identify the various numbers, let us denote by 
x,, the number occurring in the 1" row and j™ column of this array. 
If we border the rectangular array with a column of row means and a 
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row of column means, then we have a situation such as that portrayed 
in Table 1, where z,. denotes the arithmetic mean of the c values of x 
in the 1" row, x, , denotes the arithmetic mean of the r values of z in the 
j™ column, and x,, denotes the arithmetic mean of all the re values in 
the array. 

It is evident that the following is an algebraic identity whatever the 
interpretation of the numbers z,, involved: 


(1) (ty- 2, = (%,.- ..)+ (w,,-2..) a7 (%j—2,.-@,+@.,). 
Remembering that by definition the arithmetic mean of m values of a 
quantity y is (sum of the m values) /m we see that 


1 
(2) Arithmetic Mean of y=9=,,5) implies S(y—¥Y) =0, 
and 


S 2 
(3) s(y- 9)? 8(y)- EOE, 


where S denotes summation over all the values of y involved. Squaring 
both sides of (1) and summing over all rc observations, the algebraic 
identity 
(4) S(a,-2,,h =S8(a,,-2,,)?+8(x,,-2,.)? 
(A) (B) (C) 
+8 (aj-%.-@.,+2,.)? 
D 


results, where S denotes summation over all the values in the entire 
array; the cross-products involved sum to zero by virtue of (2), on 
account of the fact that x,.,x_;, etc.,and x, are means. The (A), (B), 
(C), and (D) sums of squared quantities in (4) are what are usually 
referred to in an analysis-of-variance table as the ‘‘total’’, the ‘‘be- 
tween-row-means’’, the ‘‘between-column-means’’, and ‘‘residual’’ 
sums of squares, respectively. Since (x,;,.—2x,,)? is identically the same 
for each of the c observations in the 7" row, and (x,;,—2,,)? is the same 
for each observation in the j column, it is sometimes convenient to 
write (4) as 


6G). E(x, 08 0¥ (a, a eee) 
g=1 


4=1 j=l 4=1 
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are 7 denotes summation over all the observations in the array, 


= denotes summation only over 7,7=1 to i=r, and } denotes summa- 
¢=1 j=l 
tion only over j, for j=1 to j=c. 
(3.1) “ Practical’? Formulas. With the aid of the identity (8), 
it is easy to derive the ‘‘practical’’ formulas used for calculation: 
fe Sie 
(A) 2X X(2,-2..)?= a ye? ?)- paeaduils 2 
@=1 j=1 
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(D) X U(ay-m.-2.,+2,.)?= (A) = (B)-(C). 


4=1 j=1 

I repeat: All of the familiar formulas and procedures for evalu- 
ating component ‘‘sums of squares’’ that add up to the “‘total sum of 
squares’’ are based on algebraic identities, and are valid as descriptions 
of properties of the data whatever the interpretation of the numbers 
involved.. Indeed, the fact that the ‘‘components’”’ add up to the total 
is an algebraic (or, should I say a ‘‘geometric’’) property and means 
that (and will only happen when) the respective component ‘‘sums of 
squares’’ are themselves the squares of, or sums of the squares of, linear 
combinations of the observations that summarize mutually distinct 
properties of the data, or, as a geometer would say, linear combinations 
that define mutually orthogonal vectors in the N-dimensional sample 
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space. Similarly, all of the familiar formulas and procedures for 
evaluating regression coefficients and the sum of squared deviations 
from the fitted regression, when the fitting is by the method of least 
squares, are based upon algebra and calculus, and the results obtained 
are valid as descriptions of properties of the data in hand, whatever the 
interpretation of the numbers involved. 

In summary, when the formulas and procedures of analysis of vari- 
ance are used merely to summarize properties of the data in hand, no 
assumptions are needed to validate them. On the other hand, when 
analysis of variance is used as a method of statistical inference, for 
inferring properties of the ‘‘population’”’ from which the data in hand 
were drawn, then certain assumptions, about the ‘“‘population’’ and 
the sampling procedure by means of which the data were obtained, 
must be fulfilled if the inferences are to be valid. 


4. The Assumptions Underlying the Use of Analysis of Variance 
as @ Method of Statistical Inference. As was remarked earlier, analy- 
sis of variance can be, and is, used to provide solutions to two funda- 
mentally different types of problems: On the one hand, it can be used 
to detect the existence of, and to estimate the parameters defining, fixed 
(constant) relations among the population means. These were referred 
to as problems of ClassI. On the other hand, analysis of variance can 
be used to detect the existence of, and to estimate, components of vari- 
ance. These were termed problems of Class II. To formulate with 
complete generality the mathematical models upon which the solutions 
of problems of Class I and Class II by analysis of variance are based 
would render the substance of this paper somewhat complicated from 
this point on, and would, I fear, divert attention from the really impor- 
tant distinctions between the two different models, and from the differ- 
ences between the assumptions required in order to be able to draw 
valid inferences by analysis of variance in the two cases. Therefore, 


5To see what we mean by “mutually distinct” and by “orthogonal” in practical 
language, let us note that, if in the case of numbers arranged as in Table 1 we add a 
single arbitrary constant to each of the numbers in the first column, a different arbitrary 
constant to each of the numbers in the second column, and so forth through the ct» 
column, then the several row means will be altered by different amounts, which will be 
determined by the actual constants added, but the several row means will all be altered 
by the same amount, so that the difference between any pair of row means, (@1,-—4,-), 
will be unchanged. Similarly the values of such quantities as (ai.—@..) and (wij — @i- — 
@.j+@.-) will be unchanged by this tampering with the columns, so that the “‘between- 
row-means” and the “residual” sums of squares will be unchanged also. This is because 
differences among row means (or differences of row means from the general mean) and 
the residuals are orthogonal to differences among column means (or differences of 
column means from the general mean), that is, summarize mutually distinct properties 
of the actual numbers involved. “This little trick of adding arbitrary constants in ac- 
cordance with a definite pattern is a convenient practical way of checking whether 
particular combinations of the observations are mutually orthogonal. 


8 


two different models appropriate to data arranged as in Table 1 will 
be considered in detail and the relation of each assumption to the 
inferential steps indicated : 

(4.1) Model I, Special Case: Parameters Are Population Means. 
Numbers #,, arranged as in Table 1 do not lie within the province of 
mathematical statistics, nor can any statistical inferences be based upon 
them, unless it is assumed that they are (observed values of) random 
variables of some sort. Therefore, in order to bring the discussion 
within the province of statistical inference we must make 


Assumption 1 (Random Variables) : The numbers ,; are (observed 
values of) random variables that are distributed about true mean 
values m,,, (t=1,2,...,7r;j=1,2,...,¢), that are fixed constants. 


In statistical language this assumption states that, if some particu- 
lar type of experiment leading to numbers arranged as in Table 1 were 
repeated indefinitely, then the numbers occurring in the 7 cell of the 
7 column would vary at random about an average value equal to mij, 
which is, therefore, a parameter that characterizes the expected value 
of the number z,, If, for example, the several rows of Table 1 corre- 
spond to different ‘‘varieties’’ and the several columns to different 
“‘treatments,’’ then m,; is the so-called true (or expected) yield of the 
a “‘variety’’? when subjected to the j ‘‘treatment,’’ under certain 
erowing conditions. 

Clearly the parameters m,,; can be arranged in a table analogous to 
Table 1, and bordered by the row-wise means m,., (t=1, 2,..., 7), 
and the column-wise means m,,, (j=1, 2,..., ¢) of these parameters, 
to which may be added, in the lower right corner, the mean m.. of all 
re of these parameters. If one is merely interested in obtaining un- 
biased estimates of mean differences such as m1. — Mzo, €.g., of the mean 
difference between variety 1 and variety 5 under treatment 2, then 
Assumption 1 is sufficient, and x,.—,. provides the desired estimate. 
More generally, Assumption 1 implies that an unbiased estimator of 
any linear function of the m,, with known coefficients is provided by 
the same linear function of the x, Furthermore, if the variances of 
the x, about their respective means and their intercorrelations are 
known, then the variance of any linear function of the x,,; can be evalu- 
ated, and provides a measure of the precision of this linear function 
of the z,, as an unbiased estimator of the corresponding linear function 
of the m,,. 

On the other hand, when the entries mi; of such a table of true 
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means are simple additive functions of the corresponding marginal 
means and the general mean, that is, when 


(7) m= m,.+(m,,—m,,.)+(m_,—m,.), 


for i=1, 2,...,r and j=1, 2,..., c, then the statistical inferences 
that may be based upon the z,; are of a much more satisfactory sort. 
For instance, when (7) is satisfied, the difference between an arbitrary 
pair of row-wise marginal means, e.g., m,, and m,_., is a comprehensive 
measure of the average difference in effectiveness of the factors identi- 
fied with these rows. When (7) is not satisfied, then m,,—m,, is 
merely a measure of the average difference between the effects of the 
corresponding row factors when the column factors are as in the expert- 
ment concerned. In other words, when additivity, as defined by (7), 
does not obtain, then it is not possible to define the mean difference in 
effectiveness of any given pair of the row factors, since the actual mean 
difference in effectiveness of these row factors will depend upon the 
column factor(s) concerned; and, conversely, the actual mean differ- 
ence in effectiveness of a pair of column factors will depend upon the 
row factor(s) concerned. Hence, when additivity does not prevail, we 
say that there are interactions between row factors and column factors. 
Thus, in the case of varieties and treatments considered above, addi- 
tivity implies that, under the general experimental conditions of the 
test, the true mean yield of one variety is greater (or, less) than the 
true mean yield of another variety by an amount—an additive constant, 
not a multiplier—that is the same for each of the treatments concerned, 
and, conversely, the true mean yield with one treatment is greater (or, 
less) than the true mean yield with another treatment by an amount 
that does not depend upon the variety concerned; which is exactly 
what is meant when we say that there are no ‘‘interactions’’ between 
varietal and treatment effects. 

Therefore, in order to dispense with interactions and thus make 
possible the drawing of general inferences from the z;,, let us make 


Assumption 2 (Additivity) :* the parameters mi; are related to the 


®§In its most general form Model I involves N random variables a1, @2,..., @®N 
with mean values mi, (i=1, 2, ..., N), and it is assumed that the mi are linear func- 
tions of &<N unknown parameters 6;, (j=1, 2,..., 8), With known coefficients, 
cij, the matrix of which is non-singular; thus 

mi=Cti1 i+ Ci2Gat .. . +Cte Oe 
(t= 1,2, Se eee 

and non-singularity of the matrix || ci, || signifies that from this set of N equations it 
is possible to select at least one system of s equations that is soluble with respect to 
the @’s. 

This is known as the general linear hypothesis. For details, see the papers by — 
F. N. David and J. Neyman, by S. Kolodziejezyk, and by P. C. Tang cited in the list of 
references. 
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means m,.,m_,, and m.. as specified by (7), for7=1, 2,..., 7 and 
iH eae Cs 


When Assumption 1 and Assumption 2 are satisfied, then the differ- 
ence between any pair of row-wise means of the observations 7;,, e.g., 
%».—%,;., is an unbiased estimator of the general average difference in 
effectiveness of the row factors concerned, i.e., of m,,.—m;. in this case; 
and, similarly, the difference between any pair of column-wise means 
of the observations is an unbiased estimator of the general average dif- 
ference in effectiveness of the column factors concerned. Furthermore, 
since such estimators are linear functions of the x,,, the variances of 
these estimators can be evaluated readily when the variances and inter- 
correlations of the z,, are known. On the other hand, if these variances 
and intercorrelations are unknown—the usual case in practice—then 
it is not possible to derive from the observed values of the z,,, (t= 1, 2, 

.,r;j=1,2,...,¢), an unbiased estimate of the variance of any 
single z,,, or of any particular linear combination of them, unless cer- 
tain additional conditions are fulfilled by the z,. For instance, if the 
ij are mutually uncorrelated,’ and if variance of the x;; are given 
by 
o” 


Ww 


(8) variance of «;; = 
2) 

where the relative ‘‘weights,’’ w,,, are known constants, (i= 1, 2,..., 7; 
j=1,2,...,0¢), and o? is an unknown constant, then an unbiased esti- 
mate of o?, and thence unbiased estimates of the variances of linear 
combinations of the x,,, can be derived from the observations x,, by the 
method of least squares. For details see, for example, the paper by 
F. N. David and J. Neyman cited in the list of references. They 
assume the x’s to be mutually independent, whereas it is sufficient to 
assume that they are mutually uncorrelated. 

It should be noted here that thus far the only motivation that has 
been given for the making of Assumption 2 is the more general nature 
of the inferences that may be drawn from the observed means z,, and 
%,, (=1,2,...,7r; j=1, 2,..., ¢), when it is satisfied. We shall 
now show that, in general, it is not possible to derive from the observa- 
tions x:; by the usual analysis-of-variance procedures, unbiased esti- 
mates of-the variances of the z,,, and thence of any particular linear 
combinations of them, unless Assumption 1, Assumption 2, and Assump- 
tion 3, given below, are all satisfied. 


7That is, if the covariances ¢€ 4 [@ij-—E€(01j)] [@pq—E€(@pq)] +}, where (i, j) x 
(x, a), (6 and p=1, 2,...,7r;j and q=1, 2,..., ¢), and € denotes “expected value 
of,” are all equal to zero. 
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Assumption 3 (Equal Variances and Zero Correlations) : The ran- 
dom variables x,, are homoscedastic and mutually uncorrelated, that 
is, they have a common variance o” and all covariances among them 
are zero. 


The foregoing pronouncement can be demonstrated readily by con- 
sidering the analysis-of-variance table shown as Table 2. This repre- 


TABLE 2 
ANALYSIS OF VARIANCE 


(lon- Fb five Case) 


a ee oe 
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sents the situation when Assumption 1 and Assumption 3 are both 
satisfied, but Assumption 2 is not. We notice that under these condi- 
tions each of the ‘‘mean squares’’ customarily evaluated in such cases 
will have, in general, an expected value larger than o?. If, on the other 
hand, Assumption 2 is satisfied also, then the ‘‘residual’’ mean square 
will be an unbiased estimator of o?, the variance of any single obser- 
vation x,,, This situation is portrayed in Table 3. Hence, when Assump- 
tion 1, Assumption 2, and Assumption 3 are all satisfied, an unbiased 
estimate of the variance of the difference of two observed row means 
can be evaluated from 2(residual mean square) /c; and an unbiased 
estimate of the variance of the difference of two observed column means, 
from 2(residual mean square) /r. Furthermore, under these conditions 
the between-row-means mean square in general will tend to exceed the 
residual mean square, and this tendency will be greater when the true 
row means, the m,., differ markedly in magnitude than when they differ 
only slightly. Similarly, the between-column-means mean square in 
general will tend to exceed the residual mean square by an amount that 
depends upon the degree of ‘‘scatter’’ of the true column means, the 
m.,;, about m,,, the mean of all the m,,. Thus we have yardsticks for . 
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judging whether there exist real differences among the true means for 
the row factors, and for the column factors. Unfortunately, however, 
our yardsticks have no scales, i.e., probability levels, marked on them, 
so that with them we cannot conduct exact tests of significance corre- 
sponding to previously agreed upon probability levels. In order to be 
able to do this, the form of the joint distribution of the x:; must be 
specified. To this we shall return in a moment. 


TABLE 3 
ANALYSIS OF VARIANCE 


(Additive Case) 


SH X.Y | SGX“ | oFsem-mylr-1 
SOG-XY | SHXSC-N | o+scm,-m.s(c-) 
eal 
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Total rc-l 


At this juncture let us pause for an instant to note that at has not 
been necessary to postulate mutual INDEPENDENCE of the x,, 1n order to 
achieve Table 8 and the results deducible from it—for these, existence 
of the mean values of the x,, (Assumption. 1), additivity (Assumption 
2), and equal variances and zero covariances (Assumption 3) are 
sufficient. 

Also, let us examine the situation where Assumption 1 and Assump- 
tion 2 are satisfied, but Asswmption 3 is not. In this case the four 
values of o? that appear in the last column of Table 3 must be re- 
placed, in general, by four different quantities, which we may denote 
by o1”, 027, o3”, and o4”. In general these will be complex weighted 
means of the variances and covariances of the z,,, and the neatness of 
Table 3 is lost. 

In summary, if Assumption 1 is satisfied, but if either Asswmp- 
tion 2, or Assumption 3, or both, is (are) not satisfied, then the strict 
validity of analysis of variance as a method of solution of problems of 
Class I vanishes out the window. 

Finally, even when Assumption 1, Assumption 2, and Assumption 3 
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are satisfied, it is still not possible to conduct exact tests of significance 
based on the x;; alone, e.g., tests of significance based upon Fisher’s 
z- or Snedecor’s F-distributions. Fortunately, normality, in addition 
to Assumptions 1-3, is sufficient for exact tests of significance. There- 
fore let us make 


Assumption 4 (Normality): The x, are jointly distributed in a 
multivariate normal (Gaussian) distribution. 


It may be noted that when Assumption 4 is satisfied, Assumption 1 
is partially redundant, and serves principally to define the parameters 
m,, Furthermore, zero covariances, as postulated in Assumption 3, 
taken in conjunction with normality, postulated in Assumption 4, imply 
mutual independence of the z,,. Thus independence finally sneaks in 
by the back door, so to speak. 

When Assumptions 1-4 are all satisfied, then all of the usual analy- 
sis-of-variance procedures for estimating, and testing to determine 
whether to infer the existence of, fixed linear relations, e.g., non-zero 
differences, among population means, are strictly valid. In particu- 
lar, an unbiased estimator of any given linear function of the para- 
meters ™,; is provided by the identical linear function of the observa- 
tions %;;, an unbiased estimate of its variance can be derived from the 
“‘residual’’? mean square and exact confidence limits for the value of 
the given linear function of the parameters can be deduced with the 
aid of Student’s ¢-distribution. Furthermore, when the row-wise popu- 
lation means, the m,., are all equal, then the quotient (‘‘between- 
row-means’’ mean square) /(‘‘residual’? mean square) will be dis- 
tributed according to Snedecor’s F-distribution for n,= (7-1) and 
M2 = (r—1)(c—1) degrees of freedom, respectively, which is the basis 
of the customary test of the hypothesis that the m,. are all equal, and 
the power of the test can be evaluated from the tables provided by P. C. 
Tang, and by Emma Lehmer—see references. An analogous statement 
can be made with respect to the column-wise population means, the m. ;. 

Therefore, we can summarize the foregoing by the following 
theorem : 


THEOREM I: The necessary’ and sufficient conditions for the strict 
validity of analysis-of-variance procedures for solving problems of 
Class I with respect to data arranged as in Table 1 are that 
(9) y= M+ (m,.—m_,) + (m.,+m,.) + Bigs 
(tLe ale pry alee ere) 


8 See footnote 2. 
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where the m,., m_,, and m.. are constants with 
(10) m..= Lim, /r= Lm. ;/¢ 
4=1 j= 


and the 2,, are normally and independently distributed about zero 
with a common variance o’. 


(4.2) Model IT: Parameters are Components of Variance. The pre- 
ceding discussion of the application of analysis of variance as a method 
of drawing statistical inferences about the parameters involved in the 
mathematical model of an experiment leading to numbers arranged as 
in Table 1 has been concerned entirely with the problems of Class I, 
where the parameters are means and the object of the analysis is to 
estimate these means or to infer whether certain differences among 
them are or are not zero. We shall now consider the application of 
analysis of variance as a method of statistical inference with respect 
to components of variance involved in the mathematical model of an 
experiment leading to numbers arranged as in Table 1. 

For the sake of concreteness, let us suppose for the moment that r 
animals are drawn at random from the available (large) stock of a 
given species and that some characteristic of each, say its body 
temperature, is measured on each of c days randomly located through- 
out some period of time. Such measurements could be arranged as in 
Table 1. Furthermore, let us suppose that our ultimate objective is to 

determine very precisely the body temperature characteristic of this 
species. By the body temperature characteristic of this species we 
mean that value about which the body temperatures of individual ani- 
mals from the species will vary as a result of biological variation, this 
variability being accentuated, possibly, by day-to-day vicissitudes in 
the case of each animal. Under these circumstances it will clearly be 
of interest (a) to ascertain whether there is a component of variation 
assignable to day-to-day changes in the body temperature of a single 
animal, and (b) to compare its magnitude with the component of 
variation assignable to animal-to-animal variability within the species, 
in order to have a basis for deciding whether in collecting further data 
a few animals examined on each one of many days, or many animals 
examined: on each one of only a few days, will lead to a more precise 
estimate of the mean body temperature characteristic of the species. 

These questions may be answered by analysis of variance by arrang- 

ing the data as in Table 1 and making the following assumptions: 


Assumption A (Random Variables) : The numbers x;; are (observed 
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values of) random variables that are distributed about a common 
mean value m._, @=1,2;) ..., 73 j=1,2, . 0 58) wheres 
is some fixed constant. 


Assumption B (Additivity of Components) : The random variables 
%ij are sums of component random variables, thus 


(11) tij=m..+(mi.—m ..) + (mM. 5-mM,.) +255, 
CGE teen en pS Ube & rao) 
where the (mi,—m_..), the (m.;-—m..), and the 2; are random 
variables.® 
It should be noted that Assumption A in conjunction with Assump- 
tion B implies that the mean values of the (m,.—m,.), of the (m_,- 
m..) and of the 2;;, are all zero. 
Assumption C (Zero Correlations and Homogeneous Variances) : 
The random variables (m;.—m..), (m.;-—m..), and Zi; are dis- 
tributed with variances o,?, o-”, and o”, respectively, and all covari- 
ances among them are zero. 


By following a line of reasoning similar to that presented in detail 
in the preceding section for the case of Model I, it is clear that here, 
in the case of Model II, the principal function of Assumption A is to 
bring the problem within the province of mathematical statistics; of 
Assumption B, to give specific meaning to the concept of ‘components 
of variance’’; and of Assumption C, to dispense with interactions and 
render each of the ‘‘components of variance’’ assignable to a distinct 
“‘factor.’’ It should be noted, however, that independence of the 
respective component deviations (m;.—m.,., m,;-—m_., and 2;;) of 
an «x;; from the general population mean (m_.) is not assumed—it is 
merely assumed that all covariances among them are zero, i.e., that 
they are mutually uncorrelated. 

Collectively, Assumptions A, B, and C imply that 


(12) 


07; = variance of a single observation = € (aij;-—m_.)? = 0? +0, +90" 


>, - o 
oz; .= variance of a row-wise mean = € (4; .-m_.)?=6,?+ ne 


2 
3 A o 
eke ; = variance of a column-wise mean = € (4, ;—™,.,)? =0¢7 + ns 

®In the example considered above, (mi.—m..) represents the deviation of the long- 
run mean body temperature of the it» animal from the long-run mean body temperature 
of the species; similarly, (m.4;—m..) is an adjustment for the jth day, assumed appli- 
cable to the body temperature of any animal from the species on that day. The 21j are 
“catch-alls” and represent errors of measurement, ete. 
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A , , or oe 0 
o2.. =variance of the general mean = € (x_.-m._._)?= ares 


Whence the expected values of the several mean squares of the cus- 
tomary analysis-of-variance table are as shown in the last column of 
Table 4. In brief, when Assumptions A, B, and C are satisfied, the 


TABLE 4 


ANALYSIS OF VARIANCE 
(Additive Case, Row- and Column-Factors Random) 


ecb Hose XY | SOK C-1 O+ Coe 
(Animal) Means fel SH; X..) jo Aes Ir 

2 =} fa) (4 
as SOKA aanensracy) | 


2 CPN 2, ICH) py? 
Oe F trey % 


Total Sty XEN 


residual mean square is an unbiased estimate of the ‘‘residual’’ vari- 
ance, o*; subtracting the residual mean square from the between- 
row-means mean square and dividing this difference by c, the number 
of columns, yields an unbiased estimate of the ‘‘row-factor’’ com- 
ponent of variance, o,?. By a similar procedure an unbiased estimate 
of ‘‘column-factor’’ component of variance, o-”, can be obtained. It 
may be noted in passing that the ‘‘naive’’ estimate of the over-all vari- 
ance of a single observation, furnished by the ‘‘total’’ mean square, is 
a biased estumate, and becomes unbiased only asymptotically as both 
r and c increase indefinitely. 

In summary, when Assumptions A, B, and C, or their analogs in 
more complex cases, are satisfied, the customary analysis-of-variance 
procedures yield unbiased estimates of the respective variance com- 
ponents: Details of the procedures appropriate to situations differing 
in various ways from the situation considered here will be found in 
the papers by S. Lee Crump, and by H. H. Daniels cited in the list of 
references; and in the additional references that they cite. 

Whereas Assumptions A, B, and C, or their analogs in more com- 
plex cases, are necessary’ and sufficient for the validity of analysis-of- 

10 See footnote 2. 
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variance procedures for unbiased estimation of components of variance, 
it is not possible to conduct exact tests of significance with respect to 
these components of variance, nor to derive exact confidence limits 
for them or their ratios, unless the joint distribution of the several de- 
viations in relations (11) is specified. Therefore, we shall make 
Assumption D: The deviations (m,.—m,,.), (m.,-m,.), and 
2, (t=1,2,...,7r3;9=1,2,...,¢), are all normally distributed. 


When Assumption D is satisfied, Assumptions A and B are partially 
redundant, and serve principally to define the ‘‘compositions’’ of the 
random variables x, (1=1, 2,...7, j=1, 2,...,¢). Furthermore, 
zero covariances, as postulated in Assumption C, taken in conjunction 
with normality, postulated in Assumption D, imply mutual indepen- 
dence of the deviations (m,;.—m_.), (m.,—m_..), and z,,; and thence of 
the x,; with respect to each other. So, once again, independence gets 
in by the back door. 

When Assumptions A—D are all satisfied, then all of the standard 
analysis-of-variance procedures for estimating, and testing to deter- 
mine whether to infer the existence of, components of variance are 
strictly valid. These are based on that fact that these assumptions 
are sufficient to insure that 


(a 


wa 


The quotient (Between-row-means swum of squares) /(o? + c,?) 

will be distributed as x? for (r—1) degrees of freedom, 

(b) The quotient (Between-column-means sum of squares) /(o? + 
Yoo’) will be distributed as x? for (c—1) degrees of freedom, 

(c) The quotient (Residual sum of squares) /o? will be distributed 
as x? for (r—1)(c-1) degrees of freedom, 

(d) The ‘‘quotients’’ referred to in (a), (b), and (c) will be inde- 
pendent in the probability sense, so that 

(e) The quantity 


F Between-row-means mean ar / aS mean mere) 
o 


o* + Co,” sd 
will be distributed in Snedecor’s F’-distribution for n, = (r—1) 


and m, = (r—1)(¢—1) degrees of freedom, and 
(f) The quantity 


| Sete mean saute / ee mean ee 


0? +a," o 


will be distributed according F for n, = (c—1) and 
Mz = (r—1)(c—1) degrees of freedom. 
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Thus (¢), which obtains also in the case of Model I when Assump- 
tions 1-4 are satisfied, is the basis of exact tests of hypotheses regard- 
ing the value of o”, and of the derivation of exact confidence limits for 
the value of o?. Similarly (e) is the basis of exact tests of hypotheses 
regarding the value of o;,?/c?, e.g., that o,2=0, and of the derivation 
of exact confidence limits for o,?/o”. An analogous statement holds for 
(f) in relation to o,?/o?.1 

Unfortunately, aside from testing the hypothesis that o,? = 0 or that 
o-? = 0, it is not possible to conduct exact tests of hypotheses regarding 
the absolute values of o,? and o,”, nor is it possible to derive exact con- 
fidence limits for their absolute values. 


5. Which Model—Model I or Model II? In practical work a ques- 
tion that often arises is: which model is appropriate in the present 
instanece—Model I or Model II? Basically, of course, the answer is 
clear as soon as a decision is reached on whether the parameters of 
interest specify fixed relations, or components of random variation. 
The answer depends in part, however, upon how the observations were 
obtained ; on the extent to which the experimental procedure employed 
sampled the respective variables at random. This generally provides 
the clue. For instance, when an experimenter selects two or more 
treatments, or two or more varieties, for testing, he rarely, if ever, 
draws them at random from a population of possible treatments or 
varieties ; he selects those that he believes are most promising. Accord- 
ingly Model I is generally appropriate where treatment, or variety 
comparisons are involved. On the other hand, when an experimenter 
selects a sample of animals from a herd or a species, for a study of 
the effects of various treatments, he can insure that they are a random 
sample from the herd, by introducing randomization into the sampling 
procedure, for example, by using a table of random numbers. But he 
may consider such a sample to be a random sample from the species, 
only by making the assumption that the herd itself is a random sample 
from the species. In such a case, if several herds (from the same 
species) are involved, Model II would clearly be appropriate with 
respect to the variation among the animals from each of the respective 
herds, and might be appropriate with respect to the variation of the 
herds from one another. 


41 For detailed considerations of various aspects of planning and interpreting experi- 
ments for comparing standard deviations and components of variance, the reader is 
referred to the report by A. H. J. Baines and to Chapter 8 of the forthcoming book by 
the Statistical Research Group, Columbia University, which are cited in the list of 
references at the end of this paper. 
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The most difficult decisions are usually associated with places and 
times: Are the fields on which the tests were conducted a random 
sample of the county, or of the state, etc.? Are the years in which 
the tests were conducted a random sample of years? 

When a particular experiment is being planned, or when the results 
are in and are being interpreted, the following parallel sets of questions 
serve to focus attention on the pertinent issues, and have been found 
helpful in answering the basic question of random versus fixed effects: 


(1) Ave the conclusions to be confined to the things actually studied 
(the animals, or the plots) ; to the immediate sources of these 
‘things (the herds, or the fields) ; or expanded to apply to more 
general populations (the species, or the farmland of the state) ? 

(2) In complete repetitions of the experiment would the same 
things be studied again (the same animals, or the same plots) ; 
would new samples be drawn from the identical sources (new 
samples of animals from the same herds, or new experimental 
arrangements on the same fields) ; or would new samples be 
drawn from the more general populations (new samples of 
animals from new herds, or new experimental arrangements on 
new fields) ? 


It is hoped that these queries will not only aid in reducing the reader’s 
“‘headaches,’’ but will lead him to the correct decisions. 

Finally, it needs to be said—as the reader will no doubt discover 
for himself, when he considers some specific sets of data or some pro- 
posed experiments in the light of the above queries—that real-life in- 
vestigations rarely fall entirely within the domain of Model I, or 
entirely within the domain of Model II, unless they are planned and 
conducted so as to achieve one or the other of these objectives, and 
then they may not be realistic. In consequence, some of the mean 
squares of the analysis-of-variance tables may be unbiased estimators 
of linear combinations of variance components; and others, of linear 
combinations of variance components and ‘‘mean squares’”’ of fixed 
deviations. HH. E. Daniels, in the paper cited in the list of references, 
has proposed a method of interpreting analysis-of-variance tables of 
this sort. His method consists essentially of looking at such an analy- 
sis-of-variance table through Model-II spectacles, and interpreting the 
“‘mean squares’’ of fixed deviations as variance components also. 
While this approach may be fruitful in situations of the type to which 
he has applied his method, it cannot be regarded as a general. solution 
since, the objectives of problems of Class I and problems of Class II 
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are in general quite distinct. More general methods need to be devised 
for interpreting ‘‘mixed’’ analysis-of-variance tables, particularly in 
regard to tests of significance for individual factors. 
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SOME CONSEQUENCES WHEN THE ASSUMPTIONS FOR THE 
ANALYSIS OF VARIANCE ARE NOT SATISFIED 


W. G. Cochran 
Institute of Statistics, North Carolina State College 


1. Purposes of the Analysis of Variance. The main purposes are: 


(i) To estimate certain treatment differences that are of interest. 
In this statement both the words ‘‘treatment’’ and ‘‘difference’’ are 
used in rather a loose sense: e.g., a treatment difference might be the 
difference between the mean yields of two varieties in a plant-breeding 
trial, or the relative toxicity of an unknown to a standard poison in a 
dosage-mortality experiment. We want such estimates to be efficient. 
That is, speaking roughly, we want the difference between the estimate 
and the true value to have as small a variance as can be attained from 
the data that are being analyzed. 

(ii) To obtain some idea of the accuracy of our estimates, e.g., by 
attaching to them estimated standard errors, fiducial or confidence 
limits, ete. Such standard errors, etc., should be reasonably free from 
bias. The usual property of the analysis of variance, when all assump- 
tions are fulfilled, is that estimated variances are unbiased. 

(iii) To perform tests of significance. The most common are the 
F-test of the null hypothesis that a group of means all have the same 
true value, and the ¢-test of the null hypothesis that a treatment dif- 
ference is zero or has some known value. We should like such tests to 
be valid, in the sense that if the table shows a significance probability 
of, say, 0.023, the chance of getting the observed result or a more dis- 
cordant one on the null hypothesis should really be 0.023 or something 
near it. Further, such tests should be sensitwe or powerful, meaning 
that they should detect the presence of real treatment differences as 
often as possible. 

The object of this paper is to describe what happens to these de- 
sirable properties of the analysis of variance when the assumptions 
required for the technique do not hold. Obviously, any practical value 
of the paper will be increased if advice can also be given on how to 
detect failure of the assumptions and how to avoid the more serious 
consequences. 


2. Assumptions Required for the Analysis of Variance. In setting 
up an analysis of variance, we generally recognize three types of effect : 
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(a) treatment effects—the effects of procedures deliberately intro- 
duced by the experimenter 

(b) environmental effects (the term is not ideal)—these are certain 
features of the environment which the analysis enables us to 
measure. Common examples are the effects of replications in 
a randomized blocks experiment, or of rows and columns in a 
Latin square 

(ce) experimental errors—this term includes all elements of varia- 

tion that are not taken account of in (a) or (b). 

The assumptions required in the analysis of variance for the prop- 

erties listed as desirable in section 1 are as follows: 

(1) The treatment effects and the environmental effects must be 
additive. For instance, in a randomized blocks trial the obser- 
vation yi; on the 7 treatment in the j replication is speci- 
fied as 

Yig=etrit pit Cij 


where p is the general mean, 7; is the effect of the 1 treatment, 
p; is the effect of the j replication and e;; is the experimental 
error of that observation. We may assume, without loss of 
generality, that the e’s all have zero means. 

(2) The experimental errors must all be independent. That is, the 
probability that the error of any observation has a particular 
value must not depend on the values of the errors for other 
observations. 

_ (3) The experimental errors must have a common variance.* 

(4) The experimental errors should be normally distributed. 


We propose to consider each assumption and to discuss the conse- 
quences when the assumption is not satisfied. The discussion will be 
in rather general terms, for much more research would be needed in 
order to make precise statements. Moreover, in practice several as- 
sumptions may fail to hold simultaneously. For example, in non- 
normal distributions there is usually a correlation between the variance 
of an observation and its mean, so that failure of condition (4) is likely 
to be accompanied by failure of (3) also. 

3. Previous Work on the Effects of Non-normality. Most of the 
published work on the effects of failures in the assumptions has been 

1This statement, though it applies to the simplest analyses, is an oversimplifica- 
tion. More generally, the analysis of variance should be divisible into parts within 
each of which the errors have common variance.’ For instance, in the split-plot design, 


we specify one error variance for whole-plot comparisons and a different one for sub- 
plot comparisons. 
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concerned with this item. Writing in 1938, Hey (8) gives a bibliogra- 
phy of 36 papers, most of which deal with non-normality, while several 
theoretical investigations were outside the scope of his bibliography. 
Although space does not permit a detailed survey of this literature, 
some comments on the nature of the work are relevant. 

The work is almost entirely confined to a single aspect, namely the 
effect on what we have called the validity of tests of significance. Fur- 
ther, insofar as the t-test is discussed, this is either the test of a single 
mean or of the difference between the means of two groups. As will be 
seen later, it is important to bear this restriction in mind when evalu- 
ating the scope of the results. / 

- Some writers, e.g., Bartlett (1), investigated by mathematical meth- 
ods the theoretical frequency distribution of F or ¢, assuming the null 
hypothesis true, when sampling from an infinite population that was 
non-normal. Asa rule, it is extremely difficult to obtain the distribu- 
tions in such cases. Others, e.g., E. S. Pearson (9), drew mechanically 
500 or 1000 numerical samples from an infinite non-normal population, 
calculated the value of F or t for each sample, and thus obtained em- 
pirically some idea of their frequency distributions. Where this 
method was used, the number of samples was seldom large enough to 
allow more than a chi-square goodness of fit test of the difference be- 
tween the observed and the standard distributions. A very large num- 
ber of samples is needed to determine the 5 percent point, and more 
so the 1 percent point, accurately. A third method, of which Hey’s 
paper contains several examples, is to take actual data from experi- 
ments and generate the F or t distribution by means of randomization 
‘similar to that which would be practiced in an experiment. The data 
are chosen, of course, because they represent some type of departure 
from normality. 

The consensus from these investigations is that no serious error is 
introduced by non-normality in the significance levels of the F-test or 
of the two-tailed t-test. While it is difficult to generalize about the 
range of populations that were investigated, this appears to cover most 
cases encountered in practice. If a guess may be made about the limits 
of error, the true probability corresponding to the tabular 5 percent 
significance level may lie between 4 and 7 percent. For the 1 percent 
level, the limits might be taken as 3 percent and 2 percent. As a rule, 
the tabular probability is an underestimate; that is, by using the ordi- 
nary F' and ¢ tables we tend to err in the direction of announcing too 
many significant results. 
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The one-tailed f-test is more vulnerable. With a markedly skew 
distribution of errors, where one tail is much longer than the other, the 
usual practice of calculating the significance probability as one-half the 
value read from the tables may give quite a serious over- or under- 
estimate. 

It was pointed out that work on the validity of the t-test covered 
only the cases of a single mean or of the comparison of the means of two 
groups. The results would be applicable to a randomized blocks ex- 
periment if we adopted the practice of calculating a separate error for 
each pair of treatments to be tested, using only the data from that pair 
of treatments. In practice, however, it is usual to employ a pooled 
error for all ¢-tests in an analysis, since this procedure not only saves 
labor but provides more degrees of freedom for the estimation of error. 
It will be shown in section 6 that this use of a pooled error when non- 
normality is present may lead to large errors in the significance prob- 
abilities of individual t-tests. The same remark applies to the Latin 
square and more complex arrangements, where in general it is impos- 
sible to isolate a separate error appropriate to a given pair of treat- 
ments, so that pooling of errors is unavoidable. 


4. Further Effects of Non-Normality. In addition to its effects on 
the validity of tests of significance, non-normality is likely to be accom- 
panied by a loss of efficiency in the estimation of treatment effects and 
a corresponding loss of power in the F- and t-tests. This loss of effi- 
ciency has been calculated by theoretical methods for a number of 
types of non-normal distribution. While these investigations dealt 
with the estimation of a single mean, and thus would be strictly ap- 
plicable only to a paired experiment analyzed by the method of differ- 
ences, the results are probably indicative of those that would be found 
for more complex analyses. In an attempt to use these results for our 
present purpose, the missing link is that we do not know which of the 
theoretical non-normal distributions that have been studied are typical 
of the error distributions that turn up in practice. This gap makes 
speculation hazardous, because the efficiency of analysis of variance 
methods has been found to vary from 100 percent to zero. While I 
would not wish to express any opinion very forcibly, my impression 
is that in practice the loss of efficiency is not often great. For instance, 
in an examination of the Pearson curves, Fisher (4) has proved that 
for curves that exhibit only a moderate departure from normality, the 
efficiency remains reasonably high. Further, an analysis of the logs 
of the observations instead of the observations themselves has fre- 
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quently been found successful in converting data to a scale where 
errors are approximately normally distributed. In this connection, 
Finney, (3) has shown that if log x is exactly normally distributed, 
the arithmetic mean of x has an efficiency greater than 93 percent so 
long as the coefficient of variation of x is less than 100 percent. In 
most lines of work a standard error as high as 100 percent per obser- 
vation is rare, though not impossible. 

The effect of non-normality on estimated standard errors is anal- 
ogous to the effect on the ¢-test. If a standard error is calculated 
specifically for each pair of treatments whose means are to be com- 
pared, the error variance is unbiased. Bias may arise, however, by the 
application of a pooled error to a particular pair of treatments. 

We now consider how to detect non-normality. It might perhaps 
be suggested that the standard tests for departure from normality, 
Fisher (5), should be applied to the errors in an analysis. This sug- 
gestion is not fruitful, however, because for experiments of the size 
usually conducted, the tests would detect only very violent skewness or 
kurtosis. Moreover, as is perhaps more important, it is not enough to 
detect non-normality: in order to develop an improved analysis, one 
must have some idea of the actual form of the distribution of errors, 
and for this purpose a single experiment is rarely adequate. 

Examination of the distribution of errors may be helpful where 
an extensive uniformity trial has been carried out, or where a whole 
series of experiments on similar material is available. Theoretically, 
the best procedure would be to try to find the form of the frequency 
distribution of errors, using, of course, any @ priori knowledge of the 
nature of the data. An improved method of estimation could then be 
developed by maximum likelihood. This, however, would be likely to 
lead to involved computations. For that reason, the usual technique 
in practice is to seek, from a priori knowledge or by trial and error, a 
transformation that will put the data on a scale where the errors are 
approximately normal. The hope is that in the transformed scale the 
usual analysis will be reasonably efficient. Further, we would be pre- 
pared to accept some loss in efficiency for the convenience of using a 
familiar method. Since a detailed account of transformations will be 
given by Dr. Bartlett in the following paper, this point will not be 
elaborated. 

The above remarks are intended to apply to the handling of a rather 
extensive body of data. With a single experiment, standing by itself, 
experience has indicated two features that should be watched for : 
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(i) evidence of charges in the variance from one part of the ex- 
periment to another. This case will be discussed in section 6. 
(ii) evidence of gross errors. 


5. Effects of Gross Errors. The effects of gross errors, if unde- 
tected, are obvious. The means of the treatments that are affected will 
be poorly estimated, while if a pooled error is used the standard errors 
of other treatment means will be over-estimated. An extreme example 
is illustrated by the data in Table I, which come from a randomized 
blocks experiment with four replicates. 


TABLE I 
WHEAT: RATIO oF DRY TO WET GRAIN 


Nitrogen applied 


As is likely to happen when the experimenter does not scrutinize 
his own data, the gross error was at first unnoticed when the computor 
carried out the analysis of variance, though the value is clearly impos- 
sible from the nature of the measurements. This fact justifies rejec- 
tion of the value and substitution of another by the method of missing 
plots, Yates (11). 

Where no explanation can be found for an anomalous observation, 
the case for rejection is more doubtful. Habitual rejection of outlying 
values leads to a marked underestimation of errors. An approximate 
test of significance of the contribution of the suspected observation to 
the error helps to guard against this bias. First calculate the error 
sum of squares from the actual observations. Then calculate the error 
when the suspected value is replaced by the missing-plot estimate: this 
will have one less degree of freedom and is designated the ‘‘Remain- 
der’’ in the data below. The difference represents the sum of squares 
due to the suspect. For the data above, the results are 


df: 8.8. MSS. * 
Actual Or rOr cscs 9 .04729 .00525 
Suspect .......... 1 04205 04205 
Remainder 8 00524 .000655 
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Alternatively, the contribution due to the suspected observation may 
be calculated directly and the remainder found by subtraction. If 
there are ¢ treatments and r replicates, the sum of squares is (f—1) 
(r-1)d*/tr, where d is the difference between the suspected observa- - 
tion and the value given by the missing-plot formula. In the present 
case ¢ and r are 3 and the missing-plot value is 0.7616, so that the con- 
tribution is 9(0.2734)?/16, or 0.04205.? 

The F ratio for the test of the suspect against the remainder is 64.2, 
giving a t value of 8.01, with 8 degrees of freedom. Now, assuming 
that the suspect had been examined simply because it appeared anoma- 
lous, with no explanation for the anomaly, account must be taken of 
this fact in the test of significance. What is wanted is a test appro- 
priate to the largest contribution of any observation. Such a test has 
not as yet been developed. The following is suggested as a rough ap- 
proximation. Calculate the significance probability, p, by the ordi- 
nary t table. Then use as the correct significance probability np, where 
nm is the number of degrees of freedom in the actual error. In the 
present case, with ¢ = 8.01, » is much less than 1 in a million, and con- 
sequently np is less than 1 in 100,000. In general, it would. be wise 
to insist on a rather low significance probability (e.g., 1 in 100) before 
rejecting the suspect, though a careful answer on this point requires 
knowledge of the particular types of error to which the experimenta- 
tion is subject. 


6. Hffects of Heterogeneity of Errors. If ordinary analysis of vari- 
ance methods are used when the true error variance differs from one 
observation to another, there will as a rule be a loss of efficiency in the 
estimates of treatment effects. Similarly, there will be a loss of sensi- 
tivity in tests of significance. If the changes in the error variance are 
large, these losses may be substantial. The validity of the F-test for 
all treatments is probably the least affected. Since, however, some 
treatment comparisons may have much smaller errors than others, 
t-tests from a pooled error may give a serious distortion of the signifi- 
cance levels. In the same way the standard errors of particular treat- 
ment comparisons, if derived from a pooled error, may be far from the 
true values. 


*This formula applies only to randomized blocks. Corresponding formulas can be 
found for other types of arrangements. For instance, the formula for a pxp Latin 
Square is (p—1) (p—2) d*/p?. 

* The approximation is intended only to distinguish quickly whether the probability 
is low or high and must not be regarded as accurate. For a discussion of this type of 
test in a somewhat simpler case, see E. S. Pearson and C. Chandra Sekar, Biometrika, 
Vol. 28 (1936), pp. 308-320. 
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There is no theoretical difficulty in extending the analysis of vari- 
ance so as to take account of variations in error variances. The usual 
analysis is replaced by a weighted analysis in which each observation 
is weighted in proportion to the inverse of its error variance. The ex- 
tension postulates, however, a knowledge of the relative variances of 
any two observations and this knowledge is seldom available in prac- 
tice. Nevertheless, the more exact theory can sometimes be used with 
profit in cases where we have good estimates of these relative variances. 
Suppose for instance, the situation were such that the observations 
could be divided into three parts, the error variances being constant 
within each part. If unbiased estimates of the variances within each 
part could be obtained and if these were each based on, say, at least 
15 degrees of freedom, we could recover most of the loss in efficiency 
by weighting inversely as the observed variances. This device is there- 
fore worth keeping in mind, though in complex analyses the weighted 
solution involves heavy computation. 


TABLE II 
MANGOLDS, PLANT NUMBERS PER PLOT 


| Control 
Block Total 
ey 
130 897 
112 971 
130 928 
121 1068 
493 3864 
18 


Heterogeneity of errors may arise in several ways. It may be 
produced by mishaps or damage to some part of the experiment. It 
may be present in one or two replications through the use of less homo- 
geneous material or of less carefully controlled conditions. The nature 
of the treatments may be such that some give more variable responses 
than others. An example of this type is given by the data in Table II. 

The experiment investigated the effects of three levels of chalk 
dressing and three of lime dressing on plant numbers of mangolds. 
There were four randomized blocks of eight plots each, the control 
plots being replicated twice within each block.* 

Since the soil was acid, high variability might be anticipated for the 

4The same data were discussed (in much less detail) in a previous paper, Cochran 


(2). 
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control plots as a result of partial failures on some plots. The effect 
is evident on eye inspection of the data. To a smaller extent the same 
effect is indicated on the plots receiving the single dressing of chalk 
or lime. If the variance may be regarded as constant within each treat- 
ment, there will be no loss of efficiency in the treatment means in this 
case, contrary to the usual effect of heterogeneity. Any ¢ tests will be 
affected and standard errors may be biased. In amending the analysis 
so as to avoid such disturbances, the first step is to attempt to sub- 
divide the error into homogeneous components. The simple analysis 
of variance is shown below. 


TABLE III ; 
ANALYSIS OF VARIANCE FOR MANGOLDS DaATa 


af. 8.8. M.S. 
Blocks 3 2,079). ||) eee 
PreatMeENtS) secs nvtarmnene 6 8,516 essere 
BEROD, a sssiactedeennitn concertos 22 18,939 860.9 
Total 31 29°5345° | eee 


For subdivision of the error we need the following auxiliary data. 


Diff. between Total — 4 (C2 + L2 + 03 + L3) 
Block Controls (Controls) (C1-L1) —2(C1+1L1) 
1 91 141 17 171 
2 105 255 3 9 
3 78 328 a6 -17 
4 4 52 49 43 
a ee 776 64 206 


Divisor for 


The first two columns are used to separate the contribution of the 
controls to the error. This has 7 d.f. of which 4 represent differences 
between the two controls in each block. The sum of squares of the 
first column is divided by 2 as indicated. There remain 3 d.f. which 
come from a comparison within each block of the total yield of the con- 
trols with the total yield of the dressings. Since there are 6 dressed 
plots to 2 controls per block we take 


(Dressing total) —3(Control total) = (Total) —-4(Control total) 
Thus 141 = 897 —4(140+ 49). 

By the usual rule the divisor for the sum of squares of deviations 
is 24. 
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Two more columns are used to separate the contribution of the 
single dressings. There are 6 d.f. of which 3 compare chalk with line 
at this level while the remaining 3 compare the single level with the 
higher levels. The resulting partition of the error sum of squares is 
shown below. 

TABLE IV 
PARTITION OF Error Sum or SQUARES 


df. 8.8. M.S. 
ROGAN fe cearte ccscttes sacs 22 18,939 861 
Between controls .. 4 12,703 3,176 
Controls v. Dressing: 2 3 1,860 620 
Chalk Pye Taime loin 3 850 283 
Single v. Higher Dressings 3 1,738 579 
Double and Triple Dress- 
ANG Mee cetntatatntnneen 9 1,788 199 


As an illustration of the disturbance to ¢-tests and to estimated 
standard errors, we may note that the pooled mean square, 861, is over 
four times as large as the 9 df. error, 199, obtained from the double 
and triple dressings. Consequently, the significance levels of ¢ and 
standard errors would be inflated by a factor of two if the pooled error 
were applied to comparisons within the higher dressings. 

In a more realistic approach we might postulate three error vari- 
ances, o,” for controls, o,? for single dressings and o;” for higher dress- 
ings. For these we have unbiased estimates of 3,176, 283 and 199 re- 
spectively from Table IV. The mean square for Controls v. Dressings 
(620) would be an unbiased estimate of (90,2 +017 +2017) /12, while 
that for Single v. Higher Dressings (579) would estimate (201? + 037) /3. 

What one does in handling comparisons that involve different levels 
depends on the amount of refinement that is desired and the amount 
of work that seems justifiable. The simplest process is to calculate a 
separate t-test or standard error for any comparison by obtaining the 
comparison separately within each block. Such errors, being based on 
3 d.f., would be rather poorly determined. A more complex but more 
efficient approach is to estimate the three variances from the five mean 
squares given above. Since the error variance of any comparison will 
be some linear function of these three variances, it can then be esti- 
mated. 

To summarize, heterogeneity of errors may affect certain treatments 
or certain parts of the data to an unpredictable extent. Sometimes, as 
in the previous example, such heterogeneity would be expected in ad- 
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vance from the nature of the experiment. In such cases the data may 
be inspected carefully to decide whether the actual amount of variation 
in the error variance seems enough to justify special methods. In fact, 
such inspection is worthwhile as a routine procedure and is, of course, 
the only method for detecting heterogeneity when it has not been an- 
ticipated. The principal weapons for dealing with this irregular type 
of heterogeneity are subdivision of the error variance or omission of 
parts of the experiment. Unfortunately, in complex analyses the com- 
putations may be laborious. For the Latin square, Yates (12) has 
given methods for omitting a single treatment, row or column, while 
Yates and Hale (14) have extended the process to a pair of treatments, 
rows or columns. 

In addition, there is a common type of heterogeneity that is more 
regular. In this type, which usually arises from non-normality in the 
distribution of errors, the variance of an observation is some simple 
function of its mean value, irrespective of the treatment or block con- 
cerned. For instance, in counts whose error distribution is related to 
the Poisson, the variance of an observation may be proportional to its 
mean value. Such cases, which have been most successfully handled 
by means of transformations, are discussed in more detail in Dr. Bart- 
lett’s paper. 


7. Effects of Correlations Amongst the Errors. These effects may 
be illustrated by a simple theoretical example. Suppose that the errors 
€1, €2,..., ry of the r observations on a treatment in a simple group com- 
parison have constant variance o? and that every pair has a correlation 
coefficient p. The error of the treatment total, (¢:+é2...,+¢é,r) will 
have a variance 


ro? +17 (r—1) po? 


since there are r(r—1) /2 cross-product terms, each of which will con- 
tribute 2pc?. Hence the trwe variance of the treatment mean is 


o? {1+ (r-1)p}/r. 
Now in practice we would estimate this variance by means of the sum 
of squares of deviations within the group, divided by r(r—1). But 


Mean 3(¢;—@)? = Mean & e;?—r {Mean é?} 
= Tro —o?{1+ (r—1)p} = (r—1)o7(1—p). 


Hence the estimated variance of the treatment mean is o?(1-p)/r. 
Consequently, if p is positive the treatment mean is less accurate 
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than the mean of an independent series, but is estimated to be more 
accurate. If p is negative, these conditions are reversed. Substantial 
biases in standard errors might result, with similar impairment of 
t-tests. Moreover, in many types of data, particularly field experi- 
mentation, the observations are mutually correlated, though in a more 
intricate pattern. 

Whatever the nature of the correlation system, this difficulty is 
largely taken care of by proper randomization. While mathematical 
details will not be given, the effect of randomization is, roughly speak- 
ing, that we may treat the errors as if they were independent. The 
reader may refer to a paper by Yates (13), which presents the nature 
of this argument, and to papers by Bartlett (1), Fisher (6) and Hey 
(8), which illustrate how randomization generates a close approxi- 
mation to the F and ¢ distributions. 

Occasionally it may be discovered that the data have been subject 
to some systematic pattern of environmental variation that the random- 
ization has been unable to cope with. If the environmental pattern 
obviously masks the treatment effects, resort may be had to what might 
be called desperate remedies in order to salvage some information. 

The data in Table V provide an instance. The experiment was a 2* 
factorial, testing the effects of lime (Li), fish manure (F) and artificial 
fertilizers (A). Lime was applied in the first year only; the other 
dressings were either applied in the first year only (1) or at a half 
rate every year (2). Two randomized blocks were laid out, the crop 
being pyrethrum, which forms an ingredient in many common insecti- 


TABLE V 


WEIGHTS oF Dry HEADS PER PLOT 
(Unit, 10 grams) 


Block 1 Block 2 
LAL LF2 ¥F2 Li Al Li A2 0 
84 66 70 81 63 97 56 64 
ah 1 il it il ak it i 
LF1 A2 Al FA2 Fl LA2 LA1l LFAI1 
148 137 146 171 168 158 189 152 
0 0 0 0 0 0 0 0 
LFA2 . Fl LFAI LA2 LF1 L2 LF2 FA2 
179 218 247 228 191 195 189 179 
0 0 0 0 0 0 0 0 
0 L2 0 FAL FA1L LFA2 0 ¥F2 
124 166 177 153 133 145 141 130 
0 0 0 0 0 0 0 0 
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cides. The data presented are for the fourth year of the experiment, 
which was conducted at the Woburn Experimental Farm, England. 

The weights of dry heads are shown immediately underneath the 
treatment symbols. It is evident that the first row of plots is of poor 
fertility—treatments appearing in that row have only about half the 
yields that they give elsewhere. Further, there are indications that 
every row differs in fertility, the last row being second worst and the 
third row best. The fertility gradients are especially troublesome in 
that the four untreated controls all happen to lie in outside rows. The 
two replications give practically identical totals and remove none of 
this variation. 

There is clearly little hope of obtaining information about the treat- 
ment effects unless weights are adjusted for differences in fertility 
from row to row. The adjustment may be made by covariance. 

For simplicity, adjustments for the first row only will be shown: 
these remove the most serious environmental disturbance. As x vari- 
able we choose a variable that takes the value 1 for all plots in the first 
row and zero elsewhere. The x values are shown under the weights 
in Table V. The rest of the analysis follows the usual covariance tech- 
nique, Snedecor (10). 

TABLE VI 


Sums or SQUARES AND PRODUCTS 
(y = weights, c=dummy variates) 


d.f. y? YX a? 
HES ROGIER free, esssespacece a 657 0.0 0.00 
Treatments 13 33,323 — 200.2 1.75 
Error ... 17 46,486 — 380.0 4.25 
Total ... 31 80,466 — 580.2 6.00 


Note that there are only 14 distinct treatments, since L1 is the same 
as L2. The reduction in the error 8.S. due to covariance is (380.0)?/ 
4.25, or 33,976. The error mean square is reduced from 2,734 to 782 
by means of the covariance, i.e., to less than one-third of its original 
value. The regression coefficient is — 380.0/4.25, or — 89.4 units. 

Treatment means are adjusted in the usual way. For Ll, which 
was unlucky in having two plots in the first row, the unadjusted mean 
is 89. The mean z value is 1, whereas the mean & value for the whole 
experiment is 8/32, or 4. Hence the adjustment increases the L1 mean 
by (8/4) (89.4), the adjusted value being 156. For L2, which had no 
plots in the first row, the x mean is 0, and the adjustment reduces the 
mean from 180 to 158. It may be observed that the unadjusted mean 
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of L2 was double that of L1, while the two adjusted means agree closely, 
as is reasonable since the two treatments are in fact identical. 

If it were desired to adjust separately for every row, a multiple 
covariance with four x variables could be computed. Each x would 
take the value 1 for all plots in the corresponding row and 0 elsewhere. 
It will be realized that the covariance technique, if misused, can lead 
to an underestimation of errors. It is, however, worth keeping in mind 
as an occasional weapon for difficult cases. 


8. Effects of Non-Additwity. Suppose that in a randomized blocks 
experiment, with two treatments and two replicates, the treatment and 
block effects are multiplicative rather than additive. That is, in either 
replicate, treatment B exceeds treatment A by a fixed percentage, while 
for either treatment, replicate 2 exceeds replicate 1 by a fixed percent- 
age. Consider treatment percentages of 20% and 100% and replicate 
percentages of 10% and 50%. These together provide four combina- 
tions. Taking the observation for treatment A in replicate 1 as 1.0, the 
other observations are shown in Table VII. 


TABLE VII 
HYPOTHETICAL DATA FOR Four CASES WHERE EFFECTS ARE MULTIPLICATIVE 


T 20% T 20% T 100% T 100% 
R R10% R 50% R 10% R 50% 
ep. 
A B A B A B A B 
1 1.0 1.2 1.0 1.2 10 2.0 1.0 2.0 
2 1.1 1.32 1.5 1.8 Dl 2.2 1.5 3.0 
d 02 10 -10 50 
Ona 01 05 05 625 


Thus, in the first case, 1.32 for B in replicate 2 is 1.2 times 1.1. Since 
no experimental error has been added, the error variance in a correct 
analysis should be zero. If the usual analysis of variance is applied to 
each little table, the calculated error in each case will have l df. If d 
is the sum of two corners minus the other two corners, the error S.S. 
is d?/4, so that the standard error ong is d/2 (taken as positive). The 
values of d and of ong are shown below each table. 

Consequently, in the first experiment, say, the usual analysis would 
lead to the statement that the average increase to B is 0.21 units + 0.01, 
instead of to the correct statement that the increase to B is 20%. The 
standard error, although due entirely to the failure of the additive rela- 
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tionship, does perform a useful purpose. It warns us that the actual 
increase to B over A will vary from replication to replication and 
measures how much it will vary, so far as the experiment is capable of 
supplying information on this pot. An experimenter who fails to 
see the correct method of analysis and uses ordinary methods will get 
less precise information from the experiment for predictive purposes, 
but if he notes the standard error he will not be misled into thinking 
that his information is more precise than it really is. 

When experimental errors are present, the variance ona” will be 
added to the usual error variance o,?. The ratio ona?/(ona? +o¢”) May 
appropriately be taken as a measure of the loss (fractional) of informa- 
tion due to non-additivity. In the four experiments, from left to right, 
the values of ong are respectively 0.9, 3.6, 3.2, and 13.3 percent of the 
mean yields of the experiments. In the first case, where treatment and 
replicate effects are small, the loss of information due to non-additivity 
will be trivial unless o, is very small. For example, with o, = 5 percent, 
the fractional loss is 0.81/25.81 or about 3 percent. In the two middle 
examples, where either the treatment or the replicate effect is substan- 
tial, the losses are beginning to be substantial. With o,=5 percent in 
the second case, the loss would be about 30 percent. Finally, when both 
effects are large the loss is great. 

Little study has been made in the literature of the general effects of 
non-additivity or of the extent to which this problem is present in the 
data that are usually handled by analysis of variance.’ I believe, how- 
ever, that the results from these examples are suggestive of the conse- 
quences in other cases. The principal effect is a loss of information. 
Unless experimental errors are low or there is a very serious departure 
from additivity, this loss should be negligible when treatment and rep- 
lication effects do not exceed 20 percent, since within that range the ad- 
ditive relationship is likely to be a good approximation to most types 
that may arise. 

Since the deviations from additivity are, as it were, amalgamated 
with the true error variance, the pooled error variance as calculated 
from the analysis of variance will take account of these deviations and 
should be relatively unbiased. This pooled variance may not, however, 
be applicable to comparisons between individual pairs of treatments. 
The examples above are too small to illustrate this point. But, clearly, 
with three treatments A, B, and C, the comparison (A-B) might be 
much less affected by non-additivity than the comparison (A-C). 

5A relevant discussion of this problem for regressions in general, with some inter- 


esting results, has been given recently by Jones (7). 
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Thus non-additivity tends to produce heterogeneity of the error vari- 
ance.® 

If treatment or block effects, or both, are large, it will be worth 
examining whether treatment differences appear to be independent of 
the block means, or vice versa. There are, of course, limitations to 
what can be discovered from a single experiment. If relations seem 
non-additive, the next step is to seek a scale on which effects are addi- 
tive. Again reference should be made to the paper following on trans- 
formations. 


9. Summary and Concluding Remarks. The analysis of variance 
depends on the assumptions that the treatment and environmental 
effects are additive and that the experimental errors are independent 
in the probability sense, have equal variance and are normally distrib- 
uted. Failure of any assumption will impair to some extent the stand- 
ard properties on which the widespread utility of the technique de- 
pends. Since an experimenter could rarely, if ever, convince himself 
that all the assumptions were exactly satisfied in his data, the technique 
must be regarded as approximative rather than exact. From general 
knowledge of the nature of the data and from a careful scrutiny of the 
data before analysis, it is believed that cases where the standard analy- 
sis will give misleading results or produce a serious loss of information 
can be detected in advance. 

In general, the factors that are liable to cause the most severe dis- 
turbances are extreme skewness, the presence of gross errors, anomalous 
behavior of certain treatments or parts of the experiment, marked de- 
partures from the additive relationship, and changes in the error vari- 
ance, either related to the mean or to certain treatments or parts of the 
experiment. The principal methods for an improved analysis are the 
omission of certain observations, treatments, or replicates, subdivision 
of the error variance, and transformation to another scale before analy- 
sis. In some eases, as illustrated by the numerical examples, the more 
exact methods require considerable experience in the manipulation of 
the analysis of variance. Having diagnosed the trouble, the experi- 
menter may frequently find it advisable to obtain the help of the mathe- 


matical statistician. 
®It is an over-simplification to pretend, as in the discussion above, that the devia- 
tions from addivity act entirely like an additional component of random error. Discus- 


sion of the effects introduced by the systematic nature of the deviations would, however, 
unduly lengthen this paper. 
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THE USE OF TRANSFORMATIONS 
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1. Theoretical Discussion. The purpose of this note is to summarize 
the transformations which have been used on raw statistical data, with 
particular reference to analysis of variance. For any such analysis 
the usual purpose of the transformation is to change the scale of the 
measurements in order to make the analysis more valid. Thus the 
conditions required for assessing accuracy in the ordinary unweighted 
analysis of variance include the important one of a constant residual 
or error variance, and if the variance tends to change with the mean 
level of the measurements, the variance will only be stabilized by a 
suitable change of scale. 

If the form of the change of variance with mean level is known, this 
determines the type of transformation to use. Suppose we write 


oe =f(m), (1) 
where o,” is the variance on the original scale of measurements x with 
the mean of x equal to m. Then for any function g(x) we have 
approximately? 


og? = (dg/dm)*f(m), (2) 
so that if o,? is to be constant, C? say, we must have 
Cdm 
iD) = ——". (3) 
BO Cy 


For example, if the standard deviation o, tends to be proportional to 
the mean level m, we have f(m) proportional to m?, and g(m) propor- 
tional to log m; i.e., we should use the logarithmic scale. Appropriate 
seales of this kind for types of data often encountered in statistical 
analysis are discussed in sections 2, 3, and 4. 

However, a constant variance is not the only condition we seek, and 
precautions are still necessary when using analysis of variance with 
the transformed variate. In the ideal case (cf. Reference 6 at the end 
of this paper), 


(a) The variance of the transformed variate should be unaffected 
by changes in the mean level (this is taken to be the primary 
purpose of the transformations of sections 2, 3, and 4). 

(b) The transformed variate should be normally distributed. 


1For a more precise formulation, see Reference 15. 
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(c) The transformed scale should be one for which an arithmetic 
average is an efficient estimate of the true mean level for any 
particular group of measurements. 

(d) The transformed scale should be one for which real effects are 
linear and additive. 


Although these conditions are to some extent related [for example, (a) 
and (b) and (d) together imply (c)], we obviously cannot necessarily 
expect to arrange for conditions (b), (c), and (d) to be satisfied if our 
scale has already been fixed by condition (a). 

Fortunately, the transformation of scale to meet condition (a) often 
has the effect of improving the closeness of the distribution to normal- 
ity, a correlation of variability with mean level on the original scale 
often implying excessive skewness which tends to be eliminated after 
the transformation. But the validity of any assumption of normality 
should be watched, for while moderate departures from normality are 
known not to be serious, any large departures in the region of the more 
outlying observations are likely to affect the validity of significance 
tests (cf. Reference 6). 

Condition (¢) is required because the estimates which arise in 
analysis of variance are of the simple arithmetic average type, aud we 
want to know that such estimates are efficient. The contention is some- 
times made that the original scale is the more relevant one for taking 
sums and averages, and more understandable. 

While this argument has some force and is a warning against mak- 
ing transformations without good reason, it loses strength when we 
remember that if the variability in the data varies with the mean level 
for different blocks or groups an unweighted average of the observed 
treatment responses is not necessarily the best estimate of the true 
treatment response, and the average on the transformed scale will often 
be the better estimate when re-converted to the original scale. 

Lastly, it is a more effective and a simpler procedure to be working 
on a scale for which treatment or other effects are linear and additive; 
this implies in a layout of the randomized block type that real treat- 
ment x block interactions will not inflate the error term, and reduce the 
apparent significance of the treatments; and relatedly, that for treat- 
ments of the factorial type, interactions between the treatments due 
merely to scale will not necessitate narrower and less powerful con- 
clusions about the treatment effects. Now it is not always possible to 
choose a scale to cover conditions (a) and yet be most reasonable for 
(d), though it may happen that a choice of scale for (a) improves the 
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scale to some extent as far as (d) is concerned. In some cases where 
sufficient information about the variability is known from the nature 
of the data, we may decide to abandon the advantages of a simple 
analysis of variance under condition (a), and choose our scale with 
sole regard to (d), weighting our observations with appropriate weights 
depending on the known variability. Something like this happens, for 
example, when we make use of the probit transformation (section 5; 
ef. also section 7), which is chosen to provide a rational linear scale for 
percentage mortalities or other analogous percentages. 


2. The Square Root Transformation. When statistical data consist 
of integers, i.e., whole numbers, such as number of bacterial colonies in 
a plate count, or number of plants in a given area, homogeneous con- 
ditions will often lead to variation in these numbers x following the 
Poisson distribution. Since for such a distribution the variance is 
exactly equal to the mean, we readily obtain from our general equation 
in section 1, that to stabilize the variance we must work on the square- 
root scale. We have seen that this is only an approximate result and 
the exact values for different values of the mean m seem worth quoting 
from my original paper (see Reference 1, Table I), as they may be 
useful in any comparisons of the observed variance of our data with 
this theoretical value. I recommended the use of \/(«+4) in place 
of \/x when very small numbers were involved (e.g., means in the range 
10 to 2, especially when zeros are occurring among the observed num- 
bers), and the variance for this quantity is also shown. 

In practice we often use an analysis of variance for data of the above 
integer type because we suspect heterogeneity of one kind or another 
to be present, especially if our data have been collected under field con- 


TABLE I 
VARIANCE OF POISSON VARIATE ON TRANSFORMED SCALE 


Mean m 
(on original seale) Me V (@+2) 
0.0 0.000 0.000 
0.5 0.310 0.102 
1.0 0.402 0.160 
2.0 0.390 0.214 
3.0 0.340 0.232 
4.0 0.306 0.240 
6.0 0.276 0.245 
9.0 0.263 0.247 
12.0 0.259 0.248 
15.0 0.256 0.248 
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ditions. We do not then need to assume Poisson variation, but will 
still transform to the square-root scale if the variation of \/z appears 
stable. The following set of data (quoted from Reference 1; see also 
Reference 13), representing weed-infestation counts in one of a series 
of experiments on weed control in cereals, is an example of stability of 
variance on the square-root scale, even when the level of variability is 
far higher than expected on the assumptions of a Poisson distribution 
for z. 


TABLE II 


PLAN. SHOWING LAYouT or EXPERIMENT ON OATS, AND NUMBERS OF POPPIES 
(In 3$ SQ. FT. AREAS). 


Block A 


* Control. 


As a rule, a scale chosen to stabilize variance will be one on which 
arithmetic averages will provide efficient estimates, though this require- 
ment, which-I have called condition (¢), is not altogether independent 
of (d). For data for which ‘‘homogeneity’’ represents some well- 
defined assumption such as Poisson variation, it is also useful to be sure 
that if the data were in fact homogeneous, such estimates are not throw- 
ing away too much information, and this condition is satisfied for the 
Poisson variate transformed to the square-root scale (cf. Reference 1, 
p. 69, where it was noted that the minimum percentage efficiency in 
large samples was 88 percent for \/z and 964 percent for \/(x+4)), 
even although the best estimate of the true mean of a perfectly homo- 
geneous Poisson set of observations is actually the arithmetic mean on 
the original scale. In an interesting theoretical paper, Cochran (Ref- 
erence 14) has discussed the appropriate analysis of variance for data 
of a Poisson (or binomial) type, for which real block or other group 
differences extra to the treatment effects may be present provided they 
are assumed additive on the transformed scale. He shows that the 
direct analysis of variance on the transformed scale is then really a first 
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approximation to a more exact analysis, in which any loss of efficiency 
in estimation is reduced to zero. This method, however, becomes irrele- 
vant if the data do not belong to the exact distributional type assumed, 
and consequently its use would seem rarely justifiable in practice for 
field data of the type here considered. 

3. Logarithmic Transformations. The stability of variance on the 
square-root scale in the case of the series of weed-control experiments 
was rather unexpected ; since, if considerable heterogeneity in numbers 
is present, the variance is often found still to be correlated with the 
mean level on a square-root scale, and may only be stabilized if trans- 
formation is made to the logarithmic scale. The natural explanation 
of a variance greater than the mean is that the mean level itself fluctu- 
ates, so that 


Bie = M + om?. (4) 


For biological populations, increases in numbers are often proportional 
to the numbers already present, giving rise to variations in mean from 
place to place themselves proportional to the mean. This illustrates 
how om? might be proportional to m?, so that we might expect 


O27 = M+ dA?2m?. (5) 


For ) large, or m large, this variance law implies the logarithmic trans- 
mation. 

In some problems it is possible that A could be estimated well enough 
to justify a more exact transformation corresponding to a variance of 
the type represented by equation (5). This transformation would be 
A-? Sinh-? [A\/z], or equivalently A-1 log {\/(1+A2@) +r/x} (ef. 
Reference 7). For example, it is known that under certain assump- 
tions about the way m varies, the Poisson distribution becomes a ‘‘nega- 
tive binomial”’ distribution, this distribution often fitting observational 
data which do not conform to the narrower Poisson type. For such 
data 4~* Sinh-? [\\/z] transformation would be appropriate.2 For 
small \/z it becomes equivalent to the \/z transformation, and for 
small numbers the transformation 4-1 Sinh-? [\\/(z+4)] would seem 
somewhat better. For large A\/z it becomes equivalent to the logarith- 
mic transformation. 

This transformation, however, has the disadvantage of requiring an 
approximate knowledge of A, and the empirical transformation log 
(1+), which has been suggested in place of log x as a logarithmic 
transformation for integers to avoid the difficulty with zeros in the case 

2 Compare the Sin-! /@ transformation for the ordinary binomial (section 4). 
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of log xz, seems likely to prove good enough in many eases; (it shows an 
approximate linear relationship with Sinh-+ [\\/(z+4)] for values 
of A which appear likely in practice). Beall (Reference 7) has, how- 
ever, suggested that, in entomological field experiments where an esti- 
mate of is required, two plots for each treatment should be included 
in each randomized block ; for such experimental designs the \~? Sinh-? 
[A\/z] scale would naturally be used.? 

The Sinh-? [A\/z] scale is also appropriate for the somewhat more 
general variance law : 

oa = p?(m+d?m?). (6) 

As an example‘ of data for which the empirical law (6) might have 
been fitted, the following ‘‘leatherjacket’’ counts (Table III) are cited. 
The figures refer to an experiment on the control of leatherjackets by 
the use of toxic emulsions (see Reference 2, p. 190). 


TABLE III 
LEATHERJACKET COUNTS 


Treatment 1 (Control) 2 (Control) 3 + 5 6 
Block I 92 66 19 29 16 25 
TE 60 46 35 10 11 5 

III 46 81 17 22 16 9 

IV 120 59 43 13 10 2 

Vv 49 64 25 24 8 7 

VI 134 60 52 20 28 11 


The original analysis was actually made for \/ (+4) for the treated 
plots only, the numbers on the control plots being used merely to indi- 
cate the degree of control by the treatments (see Table IV below). 


TABLE IV 
SUMMARY OF RESULTS 


Mean V (G44) cen | casein 5.58 4.43 3.84 
Mean No./plot ...... 
0/0 Control crscoson 


A comprehensive analysis of variance including the control plot 
numbers is somewhat a matter of convenience when the control plot 


* Beall gives a table in Reference 7 for values of k=)? from 0 to 1. Since this table 
is for \-1 Sinh+ [AV@] and not d-1 Sinh-? [AV (w@+4)], I would recommend the em- 
pirical correction of replacing zero values of @ by 4+ (ef. section 4). 

“See also the examples in Reference 7. 
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numbers differ considerably from the treated plot numbers. Here if 
it is desired to include control plot numbers in the analysis they might 
still reasonably be included in the square-root analysis, but the use of 
the more general variance law (6) would be safer. 

It has been noted above that when biological populations change, 
the change is often proportional to the mean, implying changes inde- 
pendent of the mean on the logarithmic scale. However, suppose the 
fraction of area covered by a species of plant is the measurement ; there 
is then a factor limiting the amount of growth, the fractional area never 
exceeding 1. In such situations I have found the transformation to 
the seale log {x/(1—«x)} useful (cf. Reference 4, p. 163). 

It is of interest to add to our list the well-known transformation 
used for a sample correlation coefficient r to make its distribution less 
skew and more stable in variance; viz., $ log {(1+7)/(1-r)}. Since 
the variance of a correlation coefficient is approximately (1 —p?)?/ 
(n—-1), where p is the true value of the coefficient and m the number 
of observations in the sample, we obtain this transformation from our 
equation (3) if we wish to make the variance independent of p. It is, 
of course, rare to have to analyze a set of correlation coefficients by 
analysis of variance, but if the problem arose the above transformation 
would be the appropriate one. 

A more important problem that does frequently occur is the analy- 
sis of variance of a set of sample variances or standard deviations. A 
detailed discussion of this problem has been given elsewhere (Refer- 
ence 6), and as I have already quoted the illustrative example once in 
this country,° I will not do so here, but merely note that the variance 
of a sample variance s? is proportional to-(c?)?, and hence the loga- 
rithmic transformation is suitable. 


4. The Inverse Sine or Angular Transformation. The inverse sine 
square-root transformation 
g(x) = Sin->/n (7) 
bears the same relation to estimated probabilities or proportions x with 
binomial variance p(1—~p) /n, where 1 is the number of individuals in 
the sample, as the square-root transformation does to a Poisson variate. 
The approximately constant variance on the new scale is 821/n, pro- 
vided that the inverse sine, which denotes an angle, is measured in 
degrees. A table in this form is given in Fisher and Yates’ TYables 
(Reference 17, p. 42; see also Reference 11). An alternative table in 
5In a paper “Applications of Analysis of Variance,’ given at Princeton University 


on November 1, 1946. 
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radians was given in Reference 3, and on this scale the variance is 
0.25/n. In Tables V and VI below are quoted (Reference 4, p. 167) 
the data and analysis of results in one of a series of experiments for 
which this transformation was used in the routine analysis. It is not 
a particularly ideal ‘‘textbook’’ example, but is useful as an example 
of the rough evaluation of insecticides in contrast with detailed evalua- 
tions for which the probit transformation (see section 5) is more appro- 
priate. The insecticides were here in the form of toxic sprays, and no 
exact dose for any insect is known. 


TABLE V 
NUMBER OF DEAD FLIES 


Treatments A B Cc D 
1 24 (25) 17 ily 
2 25 (25) 15 17 
3 24 (25) 12 17 
4 21 (25) 20 22 
5 25 (25) 21 13 


* Control (with one extra replication). 


TABLE VI 
SUMMARY OF RESULTS 


A B C D E KF G S.E, 


0/0) Rall) aeas 95 (100) 68 69 84 94 15 sectors 
SAI at oe at 1.41 (1.57) 0.98 0.99 1.22 1.34 | 0.37 | 0.082 


(radians) 


In the above analysis no correction for ‘‘discontinuity’’ was used, 
since adding one-half to the observed numbers cannot consistently be 
carried through to the top end of the scale, near 100 percent kill. It 
was, however, pointed out in a footnote to my original discussion (Ref- 
erence 4, pp. 167-168) that an empirical but fairly useful correction is 
simply to write + wherever 0 occurs (and n—4, for n), and leave 
the other integers unchanged. This correction has a similar effect in 
‘*smoothing’’ the jumps due to the data consisting of whole numbers, 
the most violent jumps on the transformed scale being from 0 to 1 (or 
from n—1 to n). 

In the theoretical discussion of Poisson and binomial variation by 
Cochran (Reference 14), already referred to in section 2, Cochran has 
pointed out (p. 346) that in an exact analysis of percentages the above 
empirical correction would become replaced by special adjustments, 
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but he also notes that such an analysis would only apply to binomial 
data. It thus appears that the empirical correction I have suggested 
will remain useful in practical applications. For example, in the series 
of insecticide experiments referred to above, the mean variance was of 
the order of 0.03, as against +x 1/25 = 0.01 for binomial variation, so 
that the assumption of exact binomial variability would certainly not 
have been tenable. 


5. The Probit Transformation. For details of the probit trans- 
formation reference should be made to Bliss’ original papers (Refer- 
ences 9 and 10). This transformation, which converts the relative 
frequency with which a normal deviate y is exceeded into the corre- 
sponding value of y, is particularly useful when such a transformed 
quantity y is linearly dependent on another variable x, so that the 
transformation converts the functional relation between these two var- 
iables to a straight line. It is well known in toxicological investigations 
that this is often achieved if 2 denotes the logarithm of the dosage,° the 
relative frequency measured being the proportion of animals surviving 
at any particular dosage. However, the method is quite general and 
is often useful in other fields [see, for example, Reference 5]. 

The fact that the variance is not constant on the transformed scale 
implies that the observations must be weighted, and this is a disad- 
vantage if analyses of variance involving more than one classification 
are required. But single classification analyses of variance are, of 
course, readily made. For example, for the data quoted in Table VII 
(see Reference 4, p. 165, and Reference 3, p. 188), the difference be- 
tween the fitted regression lines for the two groups is readily tested in 
analysis of variance form by first working out the regression lines for 
each group separately in the usual way. This analysis for each line 
(see Reference 9) would be represented algebraically by the scheme: 


Swa? Sway Swy? n df. (a) 
(Swx)?/Sw (Swa) (Swy) /Sw (Swy)?/Sw 1 df. (b) 
Sw(x—2)? Sw(x-Z)(y-49) Sw(y-y)? n-1 df. (c) 
where w denotes the weight, x log-dosage, and y probit value, and 8 
summation over the n observations. Fitted regression line: 


Y-—y-=b(a-z), where b=Sw(x-2) (y-Y)/Sw(x-2z)? 
and residual sum of squares 
Sw(y —9)?— [Sw(a2-2) (y—-¥) ]?/Sw(a-2Z)? with n — 2d. 


6 The transformation of the independent variable (e.g., to the logarithm or recip- 
rocal) in regression problems is of course a common and valid procedure. 
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TABLE VII 
FUMIGATION EXPERIMENT (24 Hours EXPOSURE) ON THE BEDBUG 


Dose Adults Nymphs 
(mg./liter) Total Dead Total Dead 

7.83 20 2 10 0 
11.76 25 3 9 5 
17.20 24 6 5 3 
19.00 23 6 11 10 
20.90 24 19 7 6 
23.20 22 8 10 5 
24.60. 13 8 18 17 
28.00 9 9 27 . 24 
29.80 28 21 4 3 
32.00 25 9 3 3 
36.90 15 14 17 17 
40.20 Ae 17 15 15 
44,90 8 8 20 20 
TRO tals cura 253 140 156 128 


If rows (a) are-now added for each group, and a new row (b) 
obtained from the total sums Swa = S,wx +S.waz, ete., we shall obtain 
a new row (c) with n,+”,.—1d.f., and a new residual sum of squares 
with n,+”.—2d.f. Subtracting the sum of the two residual sums of 
squares for the two groups with (n;—2) + (m.—2) d.f., we have a term 
with 2 d.f. representing the difference in the two regression lines. If 
further we merely pool the two rows (c) to form a new row (ce), we 
should eliminate separately the means of the two groups and obtain a 
residual sum of squares with n,+n,.—3 d.f. The difference between 
this sum of squares and the sum of the original two residual sums of 
squares for the two groups now has only 1 d.f. representing the differ- 
ence in slopes of the two regression lines. The other d.f. in the 2 df. 
previously obtained represents a further difference in position of the 
two lines. 

In this way the following analysis of variance (Table VIII) was 
obtained for the data of Table VII. 


TABLE VIII 
Sum of 
d.f. squares Mean square 

PROTLGS Ve IN VIODIS ccsscsnimeitiene 2 26.226 13.113 
Difference im position woos ah 26.216, > i ceeraeene 
Difference in slope occ 1 O01" * F) issecarsesne 
Residual 22 41.194 1.872 

Ota Francine 24 67.420 


The highly significant difference between the two groups is entirely 
arising from a simple parallel displacement of one line relative to the 
other as is evident from the separate regression equations, viz. : 


Adults: Y =4.985z — 1.563, 
Nymphs: Y = 5.0812 — 0.838. 


The same situation was also found for a further experiment at 164 
hours exposure (see Reference 2, Table IV). 

A third transformation for percentages is noted in Fisher and Yates 
(Reference 17), the transformation log {p/(1-—p)}. This transforma- 
tion( mentioned in section 3) would, like the probit transformation, not 
give for the binomial variate a variance constant on the new scale, but 
might sometimes be useful for the other reasons. Thus probabilities 
often combine in a multiplicative way which might sometimes be more 
simply dealt with on this scale when corresponding estimated prob- 
abilities are available from data. Berkson (Reference 8) has even sug- 
gested that this transformation, which he calls the ‘‘logit’’ transforma- 
tion, owing to its relation with the logistic function of population 
growth (cf. Reference 4, p. 163), is more useful than the probit trans- 
formation in bio-assay. The validity of such a claim must of course 
rest ultimately with experience, and evidence from other investigators 
on the relative value of these two transformations for particular types 
of data would be useful. 


6. Expected Normal Scores for Ranked Data. It sometimes happens 
that the data presented to the statistician are not measurements, but 
a set of ranks; e.g., an investigation might have been made to determine 
the effect of manuring treatments on the quality of oranges and several 
buyers have been asked to grade different specimens, corresponding to 
different manuring treatments, in order of preference. This might 
have been repeated for several replications. Suppose there were r 
replications, 6 buyers and ¢ treatments. Then it would be tempting 


TABLE IX 
ScHEMATIC ANALYSIS OF VARIANCE OF RANKS 


d.f. 8.8. M.S. 
Between treatments ............. t-1 x © 
Treatments x replications ... (t-1) (r-1) x Ey 
Treatments X buyers. .........- (=) (G1) 2 x 
Treatments x buyers x repli- 
cations (t-1) (0-1) (r—-1) a £ 
Total (t-1)rb ¢(#-1) rb/12 | t(¢+1)/12 
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to analyze these ranks in the usual analysis of variance way. The 
analysis would look as in Table IX. 

The treatments term would be compared with the treatments x repli- 
cations interaction ; this test being based on the average opinion of the 
buyers. If, however, the treatments x buyers was significant compared 
with the second order interaction, it would indicate anomalous opinions 
among the buyers which would condition the conclusions from the first 
test. 

With such data the variance is automatically stable, being deter- 
mined by the ranks 1, 2, . . ., ¢ for each order of preference given. 
There is no doubt that while, owing to the distribution of these ranks 
not being normal and the ranks having to some extent pre-determined 
scores, the above analysis is only approximate; it would at the same 
time often be useful. However,-it is reasonable to assume that if the 
ranked data were replaced by expected normal scores, the validity of 
the analysis of variance would be somewhat improved, so that such a 
transformation might often be worth while. Fisher and Yates (Refer- 
ence 17) give a table of such transformed scores, with corresponding 
sum of squares which would replace the quantity ¢(t?-1)/12 in the 
above analysis.” 

It has been suggested by various writers (see, for example, Refer- 
ence 18) that even when measurements are available it may be safer 
to analyze by use of ranks. If so, it is permissible further to transform 
to these expected normal scores. It might, however, be remembered 
that if we discard the original measurements apart from their order we 
are throwing away the original scale and all quantitative transforma- 
tions of it, one of which may well be relevant for estimating quantita- 
tive treatment effects and measuring interactions; such wholesale jetti- 
soning should be avoided if possible. 


7. Scales Chosen for Additivity. It was pointed out in section 1 
that requirement (d), that the transformed scale should be one for 
which real effects are likely to be linear and additive, will not neces- 
sarily be consistent with requirement (a), and that the choice of scale 
will depend on the nature of our analysis of variance problem. In sece- 
tion 5 the probit transformation was an example of a scale not chosen 
in regard to (a). 

A problem of scaling for non-numerical classified data on the basis 
of requirement (d) is discussed by Fisher (Reference 16, p. 285). 
Twelve samples of human blood tested with twelve different sera gave 


7¥or an actual numerical example of a similar analysis, see Reference 12. 
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reactions denoted (in order of strength of reaction) by the symbols -, 
2, w, (+) and +. The values 0 and 1 were assigned to the symbols — 
and + respectively and it was found that the values for the other sym- 
bols which maximized the ratio of the combined sum of squares for (1) 
the differences between the samples and (ii) the differences between the 
sera, when compared with the residual sum of squares, were 0.19 for ?, 
0.58 for w, and 0.96 for (+). These values might thus be used as scores 
for the various reactions, on the argument that the interactions of 
samples and sera have been reduced to a minimum and the seale chosen 
thus made most nearly additive. 

However, it will be appreciated by most practical statisticians that 
such detailed investigations on scale are not warranted on many data. 
Even for the data just referred to, Fisher notes that the scale repre- 
sented by the above scores is not significantly different from the scale 0, 
4, 3, 2, 1; it can also be noticed from the data (Reference 16, Table 
61.9) that one blood sample and one serum gave all w reactions, and 
while this might be regarded as evidence of the findings that the w 
reaction is somewhat isolated in ‘‘distance’’ from the others, it also 
underlines Fisher’s comment that more extensive data are desirable 
for such an analysis. 

Analogously to the above choice of scale for non-numerical data, 
it is possible to investigate transformations of scale for numerical data 
by which the ratio of the sum of squares for group differences to the 
residual sum of squares is maximized. There are, however, as already 
stressed, theoretical complications in appraising significance in an ordi- 
nary analysis of variance if the scale is not selected for constant vari- 
ance; this further complicates the present problem, since the variance 
at most will only be constant on one of the scales. If a statistician con- 
templates undertaking such an investigation, he should first be quite 
clear that he understands the basis and any limitations of the technique 
he is proposing to use and that its application to his own numerical 
material promises to be worth while. 
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* See Fisher and Yates (Reference 17) for exact values. 


ANNUAL MEETING OF THE BIOMETRICS SECTION 


The annual business meeting of the Biometrics Section was held 
December 29, 1946, in the Statler Hotel, Boston, Massachusetts, with 
President D. B. DeLury in the chair and 29 members present. Brief 
reports were heard on the reorganization of the American Statistical 
Association and on changes in the Biometrics Bulletin (now Bio- 
metrics). The report of the nominating committee, consisting of 
Churchill Hisenhart, Boyd Harshbarger (Chairman), J. A. Rigney and 
G. W. Snedecor, listed for Chairman: D. B. DeLury; Secretary: H. W. 
Norton; Section Committee: Geoffrey Beall, E. J. DeBeer, D. B. De- 
Lury, D. J. Finney, H. W. Norton and J. W. Tukey; and Editorial 
Committee: R. L. Anderson, C. I. Bliss, W. G. Cochran, Gertrude M. 
Cox (Chairman), Churchill Hisenhart, H. W. Norton, G. W. Snedecor 
and C. P. Winsor. In the absence of other nominations, this slate was 
unanimously elected. Later, the Section Committee met and discussed 
means of broadening the Section’s activities and membership. 


A NOTE FROM THE EDITORIAL COMMITTEE 


This is the first issue under our new format, which should improve 
the readability of articles. It is also the first issue under the short- 
ened title of Biometrics. It is hoped that we may soon be able to ex- 
pand into a Journal form. A slight backlog of articles is being accu- 
mulated, but not enough to put us on safe ground as yet. As a result 
of the expanding activities of the Biometrics Section, we have requested 
several authorities in associated fields to act as collaborating editors in 
securing and editing articles. To date we have received favorable 
replies from: 

W. J. Dann, Duke University School of Medicine. 

D. J. Finney, Lecturer in the Design and Analysis of Scien- 

tific Experiment, University of Oxford. 

G. E. Dickerson, Regional Swine Breeding Laboratory, Bureau 

of Animal Industry, Ames, Iowa. 
H. O. Halvorson, The Medical School, University of Minnesota. 
C. M. Mottley, Chief Eastern Inland Fishery Investigations, 
Fish and Wildlife Service, Washington, D. C. 
J. G. Osborne, Forest Service, Washington, D.C. 
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QUERIES 


CORRECTION IN QUERY NO. 33, AUGUST, 1946 

Leo A. Aroian has called attention to an oversight in the answer 
to this question. In Biometrika, Volume 33, pages 7 8-88, Merrington 
and Thompson have given ‘‘Tables of Percentage Points of the In- 
verted Beta (F) Distribution’? which include 2.5 and 0.5 percent 
points. These points are therefore the desired 5% and 1% levels for 
the symmetrical test. 


(43) 
QUERY: It appeared to me that there was a typographical error on 
page 9 of the Biometrics Bulletin for February (Vol. 2, No. 1): 
In the third line from the bottom the average value for the mean square 
is given as V+12V.p+4V,. Should not the coefficient of V, have read 
48 instead of 4? 
ANSWER: Yes. 

S. Lez Crump 

(44) 
QUERY: The simple correlation between mothers and daughters for 
winter clutch size is + .1385. There were 237 mothers and 2407 daugh- 
ters. In the calculations each daughter was paired against her mother. 
In interpreting the significance of r should we consider 236 degrees of 
freedom ? 


ANSWER: There seems to be no simple rule for cases such as this. 
The significance is certainly somewhat more assured than if the data 
were restricted to 237 mothers, each with only one daughter, but cer- 
tainly far less than if there were 2407 daughters each from a different 
mother. The number of degrees of freedom which would give the 
proper test of significance is somewhere between the 235, which would 
be proper if each dam had only one daughter, and two less than the 
geometric mean of 237 and 2407, as can be seen from the following more 
precise way of getting at it. 

Designate the observed correlation of +.1385 as x and let y be the 
correlation between the clutch size of the dam and the average clutch 


size of her k daughters. Then y=zx 4 al ail where v is the intra- 
1+(k-1)v 


class correlation between daughters of the same dam. In the present 
query the size of v is not given, but from the nature of the material it is 
probably about the same size as x—perhaps a little larger and almost 
certainly larger than x?. When k is variable its proper value in the 
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above formula is its harmonic mean, which of course will be smaller 
than its arithmetic mean. Assuming that v has the same value as x in 
the present data, and using 9 for k, we get +.29 for y. Clearly y if 
computed directly would have 235 degrees of freedom and a value of 
+.29 would certainly be significant well beyond the .01 level. The sig- 
nificance of x (which seems to be the practical point the querist had in 
mind) will be the same as that of y. 

That the ratio y/x depends not alone on the size of k but also on 
the size of v will show why no simple statement of the number of degrees 
of freedom proper for testing the significance of x can always be cor- 
rect. The number of dams and the number of daughters and the size 
of x simply do not contain all of the information needed. The size of v 
is pertinent in that if v is very high, one daughter tells us nearly as 
much about what kind of daughters that dam will have as a large num- 
ber of daughters would, while if v is very low two daughters tell 
nearly twice as much as one, four daughters tell nearly as much as 
two, ete. Another way to say it is to consider that x is the product 
of three links: record of dam to real value of dam, real value of dam 
to real value of daughter, and real value of daughter to record of 
daughter. Having many daughters per dam permits the variations 
in the last two links to cancel each other but has no such effect on any 
sources of variation which may have made low the correlation between 
record of dam and real value of that dam. 

It may also be worth noting that, if the dams were themselves 
selected on clutch size, the observed r of + .14 is probably smaller than 
would have been found in a wholly unselected population. If such 
selection is thought to have occurred, regression of daughter on dam 
would be more appropriate than correlation. 

Jay L. LusH 
(45) 
QUERY: I was interested in seeing your ‘‘Question and Answer’’ 
column recently and decided to submit a problem that has been bother- 
ing me in connection with my work here in a government agency. 

One of my assignments has been to determine the ‘‘average yearly 
rate of increase (or decrease) ’’ in a series of annual data. Thus if my 
data are 


1941 100 
1942 120 
1943 110 
1944 140 
1945 130, 
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I have always figured that from 1941 thru 1945 the total change 
has been +30 percent and, taking the fourth root of 1.30 I get an 
average annual rate of increase of 6.78 percent. 

One of my fellow workers argues that I should average the indi- 
vidual yearly percents of change. In my illustration, that would be 
an average of + 20%, — 8.33%, + 27.27% and —7.14% which gives 7.95 
percent as the answer! 

As a result of our argument, we consulted a statistician from an- 
other branch of the government, and he, using the same figures as 
above, worked out a ‘‘least squares exponential equation’’ and deter- 
mined that the average yearly rate of increase was 7.025 percent! 

May I ask a second question: In computing the first quartile from 


item or should 


data in an array, should one use the value of the a ; z 


one first compute the median and then determine the value of the 
N+1 
2 


ANSWER: As is usual with queries of this nature, the ‘‘right’’ pro- 
cedure depends on the basic hypotheses associated with the origins of 
the data, as well as the purpose to which the desired ‘‘average’’ is 
to be put. 

Method number one corresponds to finding the uniform growth 
rate, stated in terms of percent per year, such that a figure increasing 
uniformly with that growth rate would increase from 100 in 1941 to 
130 in 1945. Stated algebraically, the curve y = Ke® is fitted so that 
it will pass through the points (1941, 100) and (1945, 130). A growth 
rate established this way may be used as a descriptive figure, generally, 
in cases where the random fluctuations are small compared with the 
systematic growth, and where the departure from uniformity over the 
period in question is not too great. As an example, consider the 
growth of a baby in the first year to be a%. Then the ‘‘average 

ee 1) %. This furnishes 
100 

a common basis against which to compare the actual non-uniform 
monthly growth percentages for each particular month of the first 
year. 

Method number three corresponds to the hypothesis that y = KeP*+e, 
where the e’s are considered as independent values of a random 
variate; in other words, that the growth may be considered to be 


item of the first half of the items? 


12 
monthly rate of increase’’ is 100 ( 1 + 
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essentially uniform except for random errors, perhaps of measurement, 
or due to statistical perturbations. The other essential point here is 
that one wishes to predict y for given x values. If the above hypothe- 
sis is satisfied then the curve y= Ke* fitted by least squares on the 
logarithm of y, by considering the regression of log y on @, gives a 


prediction which minimizes the variance of the residual of log y. 

The second method corresponds to a hypothesis which is quite dif- 
ferent, namely that the various values of y(a+1)/y(«) for the suc- 
cessive values of x represent essentially independent observations on 
a random variate whose distribution does not depend on x. In this 
case, to predict y(x+1) the formula y(z+1)=fy(ax) might be used, 
where 8 is determined from the ‘‘average rate’’ as determined by 
method number 2. Comparing with method three, we see that our 
hypothesis in number 2 is that the latest observation contains within 
it the best basis from which to project to the next, whereas in number 
3 it is assumed that the deviation of the last observation from a fitted 
curve has no effect on the deviation which may occur in the next. 

In answer to the second question, the first quartile is the (k+1)st 
observation when N is of the form 4k+1; in other words, the first 

f 
quartile is given by xe, with Q, 718 if a 


N+3 


is an integer. If 


is not an integer one has a choice of procedures, depending on 


the form of distribution postulated. The usual procedure is to take 
the two observations corresponding to the integers next larger and 


next smaller an tu) 


é i.e., such that n4, aee8 <M», and then average 


a 
those two observations with weights depending on , — and Mp. 
For example one might compute 
ny Lng 
Ne eee 
LT ae Ce 
al i 
N+8 N+8 
40 4a Z 


G. W. Brown 


ABSTRACTS* 


(34) 
LOTKA, ALFRED J. (Metropolitan Life Insurance Company, 
New York). Some Applications of the Life Curve. 

Principal fields in which the life curve is used are public health, 
insurance, population analysis, and the theory of industrial replace- 
ment. 

Public health—The life table is a measure of the state of health of 
the population. It is not ideal because it takes no account of morbid- 
ity, except insofar as this finds expression in mortality. The expecta- 
tion of life at birth is frequently used as a single-number index of 
health conditions. While it is not ideal, a high correlation has been 
found between the expectation of life at birth and the death rate in: 
certain populations. Applied to the individual states of the United 
States in 1929-31, the correlation, using crude death rates, was —.752 + 
-063 ; using standardized rates, it was much higher, ~.992 + .002. 

The life table is also used for computing the years of life lost an- 
nually by deaths from individual diseases, and conversely the number 
of years that might be saved by the elimination of these causes of death. 
The effect of eliminating two or more causes jointly is greater than the 
sum of the separate effects. 

Applications in population analysis—One is the construction of 
life tables, not for individuals but for families, that is, lines of male 
descent. We may ask, for instance, out of 1,000 newborn males, how 
many will have descendants in direct male line surviving after 1, 2, 3, 
etc., generations. A life table of this character was exhibited. 

Population growth—Under certain conditions population growth 
approaches an exponential law. Ordinarily, the development of the 
formulas has used integral equations. A modification, using the raw 
data without introducing a continuous curve for the net fertility, was 
exhibited together with a tabular schedule of computation. In this 
method factorial moments enter in place of the ordinary moments 
which appear when the integral equations are used. 

The intrinsic rate of natural increase in many European countries 
has been negative in past decades, while in the United States, until the 
time of the war, it was barely positive. If, after the present higher 
birth rates are past, fertility continues to decline as formerly, or if 


* All papers read at the joint meetings of the Biometrics Section and the Institute 
of Mathematical Statistics held in conjunction with the 113th Annual Meeting of the 
American Association for the Advancement of Science in Boston, December 27-29, 1946. 
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a severe increase in the death rate should occur resulting from atomic 
bombing or biological warfare, a critical situation may arise. This 
draws attention to the unusual situation in which the human species 
finds itself. Man has been extraordinarily successful in fighting off 
other species. Consequently, the life struggle is today mainly a com- 
petition between man and man. In this competition the extraordinary 
skills and expedients which he has developed, instead of being an ad- 
vantage to him, may actually prove his undoing. 


(35) 
DEEVEY, EDWARD §., Jr. (Osborn Zoological Laboratory, Yale 
University, and Woods Hole Oceanographic Institution). Life 
Tables for Natural Populations of Animals. 

Materials for the construction of ecological life tables, in the form 
of (a) survivorship data for marked individuals, or (b) known age 
at death of large numbers of individuals, are available from several 
natural populations of animals. A third type of information, (c) the 
age structure of the natural population, is frequently obtainable from 
fisheries work. In no case have ecologists been able to observe 
directly both the age structure and the time-specific mortality rate for 
given age groups. However, if it is assumed that the population is 
at equilibrium, so that the actual age structure and the life table age 
structure are identical, information of the second and third types can 
be used in constructing life tables which are valid for particular eco- 
logical conditions, though their statistical foundation may not be rigid. 
Information of the first type can be used without qualification, when, 
as is usually the case, the animals have a sharply defined season of 
birth. When a cohort of such animals is born at a particular ‘‘in- 
stant,’’ and its survival is followed until terminus, age-specific death 
rates are directly observed. 

Survivorship curves have been prepared for several species of ani- 
mals living under natural conditions. Age at death (b) has been 
observed for the Dall mountain sheep (Murie), the herring gull 
(Paynter, unpublished), and for a sessile rotifer (Edmondson). Age 
structure (c) is known (beyond certain ages) for the common tern 
(Austin), for many species of fish, of which the haddock (Russell) is 
an example, and for the female fin whale (Wheeler). Swrvivorship 
of marked individuals has been followed in the ease of the song spar- 
row (Nice), the pheasant (Leopold), the snowshoe rabbit (Green and 
Evans), and a barnacle (Hatton). 
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When such J, curves are compared, two important points emerge. 
(1) The survivorship of animals in nature sometimes, but by no means 
always, follows the J-shaped distribution (Pearl’s “Type D’’) result- 
ing from extremely heavy mortality at early ages. Diagonal 1, curves 
(Pearl’s ‘‘Type B’’) are evidently frequent in natural as well as in 
laboratory populations. (2) The form of the I, curve is strongly 
affected by its point of origin. Bird populations, for example, can 
be considered from the time the eggs are laid, from hatching, from 
fledging, or from breeding age, and correspondingly different life 
tables will result. It is not easy to say which one should be compared 
with the life table for a mammal or an invertebrate. The point of 
universal biological equivalence for animals is doubtless fertilization 
of the ovum, but in no case can the origin of a life table be taken at 
so early an age from existing data. 

Life tables are extremely useful vehicles for comparative vital 
statistics, and ecologists are urged to make greater use of this method 
of presentation. Its advantages are illustrated by an analysis of 
Hatton’s data for the survival of barnacles, which were allowed to 
settle on experimental panels under various conditions of exposure to 
surf and to intertidal desiccation, and followed throughout life. Tak- 
ing expectation of life (e°.) as the criterion of survivorship, it can be 
shown that survival is an inverse function of population density. This 
analysis is based on a theory of two-dimensional crowding, in which 
geometric considerations make it possible to include both the radial 
growth and the initial density in evaluating the degree of crowding of 
sessile organisms on a panel. 


(36) 
DeLURY, D. B. (Virginia Polytechnic Institute). The Analysis 
of Covariance. 

A single physiological experiment is discussed in detail, bringing 
out some features of an experimental situation which call for co- 
variance methods. Numerical illustrations of the computations in- 
volved in simple and multiple covariance are given. 


(37) 
BLISS, C. I. (Connecticut Agricultural Experiment Station and 
Yale University). Biological Measurement of the Depth Dose of 
X-rays of Lettuce Seedlings. 


The data of an experiment by Henshaw and Francis on the bio- 
logical effectiveness of x-rays in a paraffin phantom have been re- 
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examined. Lettuce seeds were exposed for five different periods at six 
levels in a paraffin phantom. The root growth of the irradiated seeds 
and of the negative controls was measured after 96 hours of germina- 
tion. On the hypothesis that growth was proportional to the number 
of cells surviving treatment, the logarithm of root length was plotted 
against the length of exposure. The observations at the six different 
levels were fitted by simultaneous equations with straight lines which 
converged at zero time. 

The agreement of the observations with the computed lines was 
tested by an analysis of variance. Their linearity and convergence 
at zero time agreed with the hypothesis that a single hit is sufficient 
to killa cell. The observations were more variable at the levels nearer 
the tube, emphasizing the importance in experiments of this type of 
adjusting the length of exposure in successive levels to compensate 
for inequalities of scattering and absorption in paths of different 
lengths. 

The biological effectiveness of the radiation decreased in the paraffin 
as the 2.45 power of the value expected in air. Since the expected 
intensity of direct radiation decreased approximately as the 4.85 power 
of the value in air, scattered radiation accounted for a large part of 
the total effectiveness of the rays in paraffin. The variation among 
the 17 replicates of the experiment of the log-slopes for the six dif- 
ferent levels was examined by an analysis of variance. It disclosed 
a significant variability in respect to both average susceptibility and 
the rate at which the potency diminished in the phantom. 


(38) 

YOUDEN, W. Jj. (Boyce Thompson Institute for Plant Research, 
Ine., Yonkers 3, N. Y.). On the Question of Duplicate Analyses. 

Analyses conducted on samples of the same size yield a mean value 
and a standard deviation, but no information on any constant error 
in the analysis. If observations yi, Ys, . . . , Yn are made on samples 
of weight x1, %2, . .. , @, where the x’s form a graded series, and a 
straight line, y=a+ ba, is fitted by least squares, then a is an estimate 
of any constant error and y and bz are two independent estimates of 
the y associated with x. If a is significantly different from zero then 
bz is to be preferred to y even though it has a larger variance. When 


the x’s are of the form lw, 2w,..., mw, the variance of bz is 
2 2 

— 3 ee) as compared with the variance “for ¥. 

n n-1 n 
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(39) 
KNUDSEN, LILA F. and JACK M. CURTIS. (Food and Drug 
Administration). The Use of the Angular Transformation in Bio- 
logical Assays. 

A simplified method is given for evaluating biological assays hav- 
ing quantal responses. The probit, logit, and angular transformations 
are compared. Use of the angular transformation is advocated to 
make the weights used proportional to the number of animals on that 
particular dose. It is shown that if equal numbers of animals are 
used on each dose of standard and unknown of a two-dose assay with a 
high dose 
low dose 
termining potency and a nomograph for estimating the error of the 
assay can be constructed for use in the laboratory. 

A comparison of results calculated by the probit method with those 
calculated by the angular transformation method shows that the two 
methods give practically the same results but that the amount of time 
required to make the calculations on a two-dose assay by the two meth- 
ods is very different. Probit method calculations using the exact 
weights require one and a half or two hours; the angular transforma- 
tion method requires eight to ten minutes. 


constant ratio of doses (7=log = constant), a graph for de- 
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NEWS AND NOTES 


This issue of NEWS AND NOTES was prepared by the acting 
editor, while EDITOR COX cavorted beneath the spreading palms at 
Honolulu (and also taught some classes in Experimental Design at 
the Pineapple Research Institute). She left Raleigh on December 19 
and is expected back around April 1. Meanwhile, we received such 
inspiring messages as, ‘‘The moon last night was the most romantic 
moon I’ve ever seen.... Am going native. The messenger boy is sup- 
posed to bring me a fresh hibiscus each morning.’’ Also, such a typical 
occurrence as this was reported, ‘‘I talked the full hour today, then dis- 
missed the class. A group of men from Hawaiian Pineapple stayed 
and we had an hour and a half discussion on some of their work.’’ 
Shades of past performances in design classes! Incidentally, for the 
benefit of those readers who may have stopped off in Hawaii during the 
recent world conflagration, Miss Cox stayed at the Moana Hotel. 

R. N. JEFFERSON, who was with the Experiment Station at 
V.P.I., Blacksburg, Virginia, before entering the army, has taken a 
position as Assistant Professor of Entomology of the University of 
California and Assistant Entomologist in the Agricultural Experiment 
Station. He is working on insects which attack ornamental plants. 
He writes, ‘‘... and Southern California is a pretty nice place to live.’’ 
He was married December 24 to the Canadian girl whom he met at 
Iowa State College... . OSCAR KEMPTHORNE, formerly of the 
Rothamsted Experimental Station, has joined the staff of the Statis- 
tical Laboratory at Iowa State College. ... PAUL DENSEN has been 
appointed Chief of the Division of Medical Research Statistics, Bureau 
of Medicine and Surgery, Veterans Administration, Washington, D. C. 
The position of Assistant Professor of Preventive Medicine and Public 
Health at Vanderbilt University, vacated by Dr. Densen, has been filled 
by MARGARET MARTIN, formerly Assistant Professor of Statistics 
at the University of Minnesota....G. J. FISCHER, Instituto Fitotec- 
nico, Estanzuela, Uruguay, has requested a picture of those attending 
the 1946 summer school of the Institute of Statistics. He also reports 
that a recent guest at the Instituto was F. G. BRIEGER, who gave a 
lecture on the Indian corn of Montevideo. ... E. C. FIELLER writes 
that his permanent address is now the Department of Scientific and 
Industrial Research, National Physical Laboratory, Teddington, Mid- 
dlesex. ... ABD EL MONEIM ASHEUR is Director of the Animal 
Production Department, Faculty of Agriculture at Farouk First Uni- 
versity. His mailing address is 18 Rue Fouad First, Alexandria, 
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Egypt. ... W. A. TIMMERMAN, formerly of Johannesburg, South 
Africa, is now located in the Insurance Building, 907 15th St., N.W., 
Washington, D. C.... EH. L. WILLETT, formerly of the University 
of Hawaii, can be reached at the American Scientific Breeding Insti- 
tute, 134 N. LaSalle Street, Chicago. ... W. G. MATHENY has trans- 
ferred from the Experiment Station at Fort Hays, Kansas, to the De- 
partment of Psychology, University of Maryland. 

A letter has just been received from H. FAIRFIELD SMITH, now 
back at the Rubber Research Institute of Malaya, P. O. Box 150, Kuala 
Lumpur, Federated Malay States. It has been rumored that he was 
a prisoner of war during the Japanese control of Malaya, although no 
news of his war experiences was given in his letter. Almost all of his 
reprints were lost, and I am sure he would appreciate receiving any 
reprints. which the readers of Biometrics might have available. 
Fairfield Smith’s work on discriminant functions as applied to plant 
selection has been widely used in recent years by animal as well as 
plant breeders. A brief article by him on an approximation to the 
number of degrees of freedom in a composite variance is now being 
extended to both analysis of variance problems and to an approximate 
solution of the classic Behrens-Fisher problem. ... The nature of the 
Fairfield Smith approximation to the solution of the Behrens-Fisher 
problem was discussed by M. 8S. BARTLETT at a University of North 
Carolina seminar on January 29. This seminar preceded a farewell 
banquet given for Professor Bartlett who has returned to Cambridge 
University after a four-months stay with the Institute of Statistics. 
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